Competition
Cross-Domain MetaDL: Any-Way Any-Shot Learning Competition with Novel Datasets from Practical Domains
Dustin Carrión-Ojeda · Ihsan Ullah · Sergio Escalera · Isabelle Guyon · Felix Mohr · Manh Hung Nguyen · Joaquin Vanschoren
Virtual
Meta-learning aims to leverage the experience from previous tasks to solve new tasks using only little training data, train faster and/or get better performance. The proposed challenge focuses on "cross-domain meta-learning" for few-shot image classification using a novel "any-way" and "any-shot" setting. The goal is to meta-learn a good model that can quickly learn tasks from a variety of domains, with any number of classes also called "ways" (within the range 2-20) and any number of training examples per class also called "shots" (within the range 1-20). We carve such tasks from various "mother datasets" selected from diverse domains, such as healthcare, ecology, biology, manufacturing, and others. By using mother datasets from these practical domains, we aim to maximize the humanitarian and societal impact. The competition is with code submission, fully blind-tested on the CodaLab challenge platform. A single (final) submission will be evaluated during the final phase, using ten datasets previously unused by the meta-learning community. After the competition is over, it will remain active to be used as a long-lasting benchmark resource for research in this field. The scientific and technical motivations of this challenge include scalability, robustness to domain changes, and generalization ability to tasks (a.k.a. episodes) in different regimes (any-way any-shot).
Schedule
Tue 3:00 a.m. - 3:10 a.m.
|
Competition introduction
(
Opening remarks
)
>
|
Dustin Carrión-Ojeda 🔗 |
Tue 3:10 a.m. - 3:15 a.m.
|
Winners announcement
(
Presentation
)
>
|
Dustin Carrión-Ojeda 🔗 |
Tue 3:15 a.m. - 3:40 a.m.
|
Towards better benchmarks for AutoML, meta-learning and continual learning in computer vision
(
Keynote Presentation
)
>
|
Joaquin Vanschoren 🔗 |
Tue 3:40 a.m. - 4:05 a.m.
|
AutoML for Neural Network Robustness Verification
(
Keynote Presentation
)
>
|
Jan van Rijn 🔗 |
Tue 4:05 a.m. - 4:15 a.m.
|
Break
|
🔗 |
Tue 4:15 a.m. - 4:35 a.m.
|
Baselines explanation and competition results
(
Presentation
)
>
|
Dustin Carrión-Ojeda 🔗 |
Tue 4:35 a.m. - 4:50 a.m.
|
Team MetaBeyond
(
Presentation
)
>
|
🔗 |
Tue 4:50 a.m. - 5:05 a.m.
|
Team EmmanuelPintelas
(
Presentation
)
>
|
🔗 |
Tue 5:05 a.m. - 5:10 a.m.
|
Break
|
🔗 |
Tue 5:10 a.m. - 5:25 a.m.
|
Team CDML
(
Presentation
)
>
|
🔗 |
Tue 5:25 a.m. - 5:35 a.m.
|
Closing remarks and new challenge announcements
(
Discussion and Q&A
)
>
|
Dustin Carrión-Ojeda 🔗 |
-
|
Fifteen-minute Competition Overview Video
(
Overview
)
>
SlidesLive Video |
Dustin Carrión-Ojeda · Ihsan Ullah · Sergio Escalera · Isabelle Guyon · Felix Mohr · Manh Hung Nguyen · Joaquin Vanschoren 🔗 |