Timezone: »

 
Poster
Infinite Mixture Prototypes for Few-shot Learning
Kelsey Allen · Evan Shelhamer · Hanul Shin · Josh Tenenbaum

Wed Jun 12 06:30 PM -- 09:00 PM (PDT) @ Pacific Ballroom #87
in Posters Wed »

We propose infinite mixture prototypes to adaptively represent both simple and complex data distributions for few-shot learning. Infinite mixture prototypes combine deep representation learning with Bayesian nonparametrics, representing each class by a set of clusters, unlike existing prototypical methods that represent each class by a single cluster. By inferring the number of clusters, infinite mixture prototypes interpolate between nearest neighbor and prototypical representations in a learned feature space, which improves accuracy and robustness in the few-shot regime. We show the importance of adaptive capacity for capturing complex data distributions such as super-classes (like alphabets in character recognition), with 10-25% absolute accuracy improvements over prototypical networks, while still maintaining or improving accuracy on standard few-shot learning benchmarks. By clustering labeled and unlabeled data with the same rule, infinite mixture prototypes achieve state-of-the-art semi-supervised accuracy, and can perform purely unsupervised clustering, unlike existing fully- and semi-supervised prototypical methods.

Keywords: Metric Learning · Others · Representation Learning · Semi-supervised learning · Transfer and Multitask Learning

Author Information

Kelsey Allen (Massachusetts Institute of Technology)
Evan Shelhamer (UC Berkeley)
Hanul Shin (Massachusetts Institute of Technology)
Josh Tenenbaum (MIT)

Joshua Brett Tenenbaum is Professor of Cognitive Science and Computation at the Massachusetts Institute of Technology. He is known for contributions to mathematical psychology and Bayesian cognitive science. He previously taught at Stanford University, where he was the Wasow Visiting Fellow from October 2010 to January 2011. Tenenbaum received his undergraduate degree in physics from Yale University in 1993, and his Ph.D. from MIT in 1999. His work primarily focuses on analyzing probabilistic inference as the engine of human cognition and as a means to develop machine learning.

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors