Timezone: »
Classical linear metric learning methods have recently been extended along two distinct lines: deep metric learning methods for learning embeddings of the data using neural networks, and Bregman divergence learning approaches for extending learning Euclidean distances to more general divergence measures such as divergences over distributions. In this paper, we introduce deep Bregman divergences, which are based on learning and parameterizing functional Bregman divergences using neural networks, and which unify and extend these existing lines of work. We show in particular how deep metric learning formulations, kernel metric learning, Mahalanobis metric learning, and moment-matching functions for comparing distributions arise as special cases of these divergences in the symmetric setting. We then describe a deep learning framework for learning general functional Bregman divergences, and show in experiments that this method yields superior performance on benchmark datasets as compared to existing deep metric learning approaches. We also discuss novel applications, including a semi-supervised distributional clustering problem, and a new loss function for unsupervised data generation.
Author Information
Kubra Cilingir (Boston University)
Rachel Manzelli (Boston University)
Brian Kulis (Boston University)
More from the Same Authors
-
2023 Poster: Supervised Metric Learning to Rank for Retrieval via Contextual Similarity Optimization »
Christopher Liao · Theodoros Tsiligkaridis · Brian Kulis -
2022 : Panel Discussion »
Mirco Ravanelli · Chris Donahue · Zhifeng Kong · Wei-Ning Hsu · Rachel Manzelli · Sadie Allen -
2022 Workshop: Machine Learning for Audio Synthesis »
Rachel Manzelli · Brian Kulis · Sadie Allen · Sander Dieleman · Yu Zhang -
2022 : Opening remarks »
Brian Kulis -
2022 Poster: Faster Algorithms for Learning Convex Functions »
Ali Siahkamari · Durmus Alp Emre Acar · Christopher Liao · Kelly Geyer · Venkatesh Saligrama · Brian Kulis -
2022 Spotlight: Faster Algorithms for Learning Convex Functions »
Ali Siahkamari · Durmus Alp Emre Acar · Christopher Liao · Kelly Geyer · Venkatesh Saligrama · Brian Kulis -
2020 Poster: Piecewise Linear Regression via a Difference of Convex Functions »
Ali Siahkamari · Aditya Gangrade · Brian Kulis · Venkatesh Saligrama -
2019 : Poster Session »
Ivana Balazevic · Minae Kwon · Benjamin Lengerich · Amir Asiaee · Alex Lambert · Wenyu Chen · Yiming Ding · Carlos Florensa · Joseph E Gaudio · Yesmina Jaafra · Boli Fang · Ruoxi Wang · Tian Li · SWAMINATHAN GURUMURTHY · Andy Yan · Kubra Cilingir · Vithursan (Vithu) Thangarasa · Alexander Li · Ryan Lowe -
2019 Workshop: Joint Workshop on On-Device Machine Learning & Compact Deep Neural Network Representations (ODML-CDNNR) »
Sujith Ravi · Zornitsa Kozareva · Lixin Fan · Max Welling · Yurong Chen · Werner Bailer · Brian Kulis · Haoji Hu · Jonathan Dekhtiar · Yingyan Lin · Diana Marculescu