Timezone: »
Poster
Bayesian Nonparametric Federated Learning of Neural Networks
Mikhail Yurochkin · Mayank Agarwal · Soumya Ghosh · Kristjan Greenewald · Nghia Hoang · Yasaman Khazaeni
In federated learning problems, data is scattered across different servers and exchanging or pooling it is often impractical or prohibited. We develop a Bayesian nonparametric framework for federated learning with neural networks. Each data server is assumed to provide local neural network weights, which are modeled through our framework. We then develop an inference approach that allows us to synthesize a more expressive global network without additional supervision, data pooling and with as few as a single communication round. We then demonstrate the efficacy of our approach on federated learning problems simulated from two popular image classification datasets.
Author Information
Mikhail Yurochkin (IBM Research AI)
Mayank Agarwal (IBM Research)
Soumya Ghosh (IBM Research)
Kristjan Greenewald (IBM)
Nghia Hoang (MIT-IBM Watson AI Lab, IBM Research)
Yasaman Khazaeni (IBM Research)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Oral: Bayesian Nonparametric Federated Learning of Neural Networks »
Wed Jun 12th 10:15 -- 10:20 PM Room Hall A
More from the Same Authors
-
2021 : Sliced Mutual Information: A Scalable Measure of Statistical Dependence »
Ziv Goldfeld · Kristjan Greenewald -
2021 : Entropic Causal Inference: Identifiability for Trees and Complete Graphs »
Spencer Compton · Murat Kocaoglu · Kristjan Greenewald · Dmitriy Katz -
2021 Poster: Outlier-Robust Optimal Transport »
Debarghya Mukherjee · Aritra Guha · Justin Solomon · Yuekai Sun · Mikhail Yurochkin -
2021 Spotlight: Outlier-Robust Optimal Transport »
Debarghya Mukherjee · Aritra Guha · Justin Solomon · Yuekai Sun · Mikhail Yurochkin -
2021 : Model fusion via single-round FL »
Mikhail Yurochkin -
2021 Expo Talk Panel: Enterprise-Strength Federated Learning: New Algorithms, New Paradigms, and a Participant-Interactive Demonstration Session »
L W · Nathalie Baracaldo · Chaitanya Kumar · Parijat Dube · Mikhail Yurochkin · Theodoros Salonidis · Shiqiang Wang -
2020 Poster: Model Fusion with Kullback--Leibler Divergence »
Sebastian Claici · Mikhail Yurochkin · Soumya Ghosh · Justin Solomon -
2020 Poster: Learning Task-Agnostic Embedding of Multiple Black-Box Experts for Multi-Task Model Fusion »
Nghia Hoang · Thanh Lam · Bryan Kian Hsiang Low · Patrick Jaillet -
2020 Poster: Two Simple Ways to Learn Individual Fairness Metrics from Data »
Debarghya Mukherjee · Mikhail Yurochkin · Moulinath Banerjee · Yuekai Sun -
2019 Poster: Collective Model Fusion for Multiple Black-Box Experts »
Minh Hoang · Nghia Hoang · Bryan Kian Hsiang Low · Carleton Kingsford -
2019 Poster: Estimating Information Flow in Deep Neural Networks »
Ziv Goldfeld · Ewout van den Berg · Kristjan Greenewald · Igor Melnyk · Nam Nguyen · Brian Kingsbury · Yury Polyanskiy -
2019 Oral: Estimating Information Flow in Deep Neural Networks »
Ziv Goldfeld · Ewout van den Berg · Kristjan Greenewald · Igor Melnyk · Nam Nguyen · Brian Kingsbury · Yury Polyanskiy -
2019 Oral: Collective Model Fusion for Multiple Black-Box Experts »
Minh Hoang · Nghia Hoang · Bryan Kian Hsiang Low · Carleton Kingsford -
2018 Poster: Structured Variational Learning of Bayesian Neural Networks with Horseshoe Priors »
Soumya Ghosh · Jiayu Yao · Finale Doshi-Velez -
2018 Oral: Structured Variational Learning of Bayesian Neural Networks with Horseshoe Priors »
Soumya Ghosh · Jiayu Yao · Finale Doshi-Velez