Timezone: »
In multi-task learning, a learner is given a collection of prediction tasks and needs to solve all of them. In contrast to previous work, which required that annotated training data must be available for all tasks, we consider a new setting, in which for some tasks, potentially most of them, only unlabeled training data is provided. Consequently, to solve all tasks, information must be transferred between tasks with labels and tasks without labels. Focusing on an instance-based transfer method we analyze two variants of this setting: when the set of labeled tasks is fixed, and when it can be actively selected by the learner. We state and prove a generalization bound that covers both scenarios and derive from it an algorithm for making the choice of labeled tasks (in the active case) and for transferring information between the tasks in a principled way. We also illustrate the effectiveness of the algorithm on synthetic and real data.
Author Information
Anastasia Pentina (IST Austria)
Christoph H. Lampert (IST Austria)
Related Events (a corresponding poster, oral, or spotlight)
-
2017 Talk: Multi-task Learning with Labeled and Unlabeled Tasks »
Mon. Aug 7th 07:51 -- 08:09 AM Room C4.6 & C4.7
More from the Same Authors
-
2021 : Invited talk1:Q&A »
Christoph H. Lampert -
2020 : Invited Talk: Christoph H. Lampert "Learning Theory for Continual and Meta-Learning" »
Christoph H. Lampert -
2020 Poster: On the Sample Complexity of Adversarial Multi-Source PAC Learning »
Nikola Konstantinov · Elias Frantar · Dan Alistarh · Christoph H. Lampert -
2019 Poster: Robust Learning from Untrusted Sources »
Nikola Konstantinov · Christoph H. Lampert -
2019 Poster: Towards Understanding Knowledge Distillation »
Mary Phuong · Christoph H. Lampert -
2019 Oral: Towards Understanding Knowledge Distillation »
Mary Phuong · Christoph H. Lampert -
2019 Oral: Robust Learning from Untrusted Sources »
Nikola Konstantinov · Christoph H. Lampert -
2018 Poster: Learning equations for extrapolation and control »
Subham S Sahoo · Christoph H. Lampert · Georg Martius -
2018 Oral: Learning equations for extrapolation and control »
Subham S Sahoo · Christoph H. Lampert · Georg Martius -
2018 Poster: Data-Dependent Stability of Stochastic Gradient Descent »
Ilja Kuzborskij · Christoph H. Lampert -
2018 Oral: Data-Dependent Stability of Stochastic Gradient Descent »
Ilja Kuzborskij · Christoph H. Lampert -
2017 Poster: PixelCNN Models with Auxiliary Variables for Natural Image Modeling »
Alexander Kolesnikov · Christoph H. Lampert -
2017 Talk: PixelCNN Models with Auxiliary Variables for Natural Image Modeling »
Alexander Kolesnikov · Christoph H. Lampert