PT Journal
AU Adrien Pavao
   Isabelle Guyon
   Anne-Catherine Letournel
   Dinh-Tuan Tran
   Xavier Baro
   Hugo Jair Escalante
   Sergio Escalera
   Tyler Thomas
   Zhen Xu
TI CodaLab Competitions: An Open Source Platform to Organize Scientific Challenges
SO Journal of Machine Learning Research
JI JMLR
PY 2023
AB CodaLab Competitions is an open source web platform designed to help data scientists and research teams to crowd-source the resolution of machine learning problems through the organization of competitions, also called challenges or contests. CodaLab Competitions provides useful features such as multiple phases, results and code submissions, multi-score leaderboards, and jobs runninginside Docker containers. The platform is very flexible and can handle large scale experiments, by allowing organizers to upload large datasets and provide their own CPU or GPU compute workers.
ER