Organizer guide

This is a complete guide about how to organize your own competition on CodaLab Competitions platform.

• Codalab competition roadmap. For advanced users desiring more flexibility, Codalab competition bundles allow arbitrary number of phases and metrics, use of customized ingestion and scoring programs, and more...
  • Sample Competitions
  • Building a Competition Bundle
  • Building an Ingestion Program
  • Building a Scoring Program
  • All competition features in the YAML configuration file and the editor.
  • Running a Competition (manage submissions, dumps, etc.)
  • Configuring the leaderboard
• Enabling...
  • Large datasets and hot changes of data and code during competitions.
  • Forum
  • Teams
  • Leaderboard features and public submissions.
  • Automatic code forward: The last submission of one phase becomes the first one of the next phase.
  • Dockers: Run your competition in a specific docker.
  • Audit trail
  • Coopetitions
  • Chagrade Features
• Contacting your participants
• Accessing Codalab from your own website with Codalab REST API