TY  - CONF
AU  - Zhengying Liu
AU  - Adrien Pavao
AU  - Zhen Xu
AU  - Sergio Escalera
AU  - Isabelle Guyon
AU  - Julio C. S. Jacques Junior
AU  - Meysam Madadi
AU  - Sebastien Treguer
A2  - ICML
PY  - 2020//
TI  - How far are we from true AutoML: reflection from winning solutions and results of AutoDL challenge
BT  - 7th ICML Workshop on Automated Machine Learning
N2  - Following the completion of the AutoDL challenge (the final challenge in the ChaLearnAutoDL challenge series 2019), we investigate winning solutions and challenge results toanswer an important motivational question: how far are we from achieving true AutoML?On one hand, the winning solutions achieve good (accurate and fast) classification performance on unseen datasets. On the other hand, all winning solutions still contain aconsiderable amount of hard-coded knowledge on the domain (or modality) such as image,video, text, speech and tabular. This form of ad-hoc meta-learning could be replaced bymore automated forms of meta-learning in the future. Organizing a meta-learning challenge could help forging AutoML solutions that generalize to new unseen domains (e.g.new types of sensor data) as well as gaining insights on the AutoML problem from a morefundamental point of view. The datasets of the AutoDL challenge are a resource that canbe used for further benchmarks and the code of the winners has been outsourced, which isa big step towards “democratizing” Deep Learning.
L1  - http://refbase.cvc.uab.es/files/LPX2020.pdf
N1  - HUPBA
ID  - Zhengying Liu2020
ER  -