Meta-learning from Learning Curves Challenge: ...
Document type :
Pré-publication ou Document de travail
Title :
Meta-learning from Learning Curves Challenge: Lessons learned from the First Round and Design of the Second Round
Author(s) :
Nguyen, Manh [Auteur correspondant]
Chalearn
Sun, Lisheng [Auteur]
Chalearn
Grinsztajn, Nathan [Auteur]
Scool [Scool]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Guyon, Isabelle [Auteur]
TAckling the Underspecified [TAU]
Chalearn
Laboratoire Interdisciplinaire des Sciences du Numérique [LISN]
Chalearn
Sun, Lisheng [Auteur]
Chalearn
Grinsztajn, Nathan [Auteur]
Scool [Scool]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Guyon, Isabelle [Auteur]
TAckling the Underspecified [TAU]
Chalearn
Laboratoire Interdisciplinaire des Sciences du Numérique [LISN]
HAL domain(s) :
Informatique [cs]/Intelligence artificielle [cs.AI]
English abstract : [en]
Meta-learning from learning curves is an important yet often neglected research area in the Machine Learning community. We introduce a series of Reinforcement Learning-based meta-learning challenges, in which an agent ...
Show more >Meta-learning from learning curves is an important yet often neglected research area in the Machine Learning community. We introduce a series of Reinforcement Learning-based meta-learning challenges, in which an agent searches for the best suited algorithm for a given dataset, based on feedback of learning curves from the environment. The first round attracted participants both from academia and industry. This paper analyzes the results of the first round (accepted to the competition program of WCCI 2022), to draw insights into what makes a meta-learner successful at learning from learning curves. With the lessons learned from the first round and the feedback from the participants, we have designed the second round of our challenge with a new protocol and a new meta-dataset. The second round of our challenge is accepted at the AutoML-Conf 2022 and currently ongoing .Show less >
Show more >Meta-learning from learning curves is an important yet often neglected research area in the Machine Learning community. We introduce a series of Reinforcement Learning-based meta-learning challenges, in which an agent searches for the best suited algorithm for a given dataset, based on feedback of learning curves from the environment. The first round attracted participants both from academia and industry. This paper analyzes the results of the first round (accepted to the competition program of WCCI 2022), to draw insights into what makes a meta-learner successful at learning from learning curves. With the lessons learned from the first round and the feedback from the participants, we have designed the second round of our challenge with a new protocol and a new meta-dataset. The second round of our challenge is accepted at the AutoML-Conf 2022 and currently ongoing .Show less >
Language :
Anglais
ANR Project :
Collections :
Source :
Files
- https://hal.archives-ouvertes.fr/hal-03725313/document
- Open access
- Access the document
- http://arxiv.org/pdf/2208.02821
- Open access
- Access the document
- https://hal.archives-ouvertes.fr/hal-03725313/document
- Open access
- Access the document
- https://hal.archives-ouvertes.fr/hal-03725313/document
- Open access
- Access the document
- document
- Open access
- Access the document
- main.pdf
- Open access
- Access the document
- 2208.02821
- Open access
- Access the document
- document
- Open access
- Access the document
- main.pdf
- Open access
- Access the document