Timezone: »
Federated learning is a recent and rapidly expanding area of machine learning that allows parties to benefit from joint training of models whilst respecting the privacy of each party's data. IBM Research has a broad effort in federated learning comprising novel methods, models and paradigms and offers an enterprise-strength federated learning platform free to use for non-commercial purposes, the IBM Federated Learning Community Edition.
The session will give an overview through a series of 7 short talks on the most exciting new research results from IBM Research in federated learning. Questions shall be collected using the Chat window and addressed after the lightning talks as well as after the live-interactive demo.
Sun 5:00 p.m. - 5:07 p.m.
|
Adaptive Federated Learning for Communication and Computation Efficiency (2021 IEEE Leonard Prize-winning work).
(New FL Paradigms: Lightning talk #1)
SlidesLive Video » Federated learning is a recent and rapidly expanding area of machine learning that allows parties to benefit from joint training of models whilst respecting the privacy of each party's data. IBM Research has a broad effort in federated learning comprising novel methods, models and paradigms and offers an enterprise-strength federated learning platform free to use for non-commercial purposes, the IBM Federated Learning Community Edition. The session will give an overview through a series of 7 short talks on the most exciting new research results from IBM Research in federated learning. Questions shall be collected using the Chat window and addressed after the lightning talks as well as after the live-interactive demo. |
Shiqiang Wang 🔗 |
Sun 5:07 p.m. - 5:13 p.m.
|
Fed+ for robustness and personalization
(New FL Paradigms: Lighning talk #2)
SlidesLive Video » |
L W 🔗 |
Sun 5:13 p.m. - 5:20 p.m.
|
Model fusion via single-round FL
(New FL Paradigms: Lightning talk #3)
SlidesLive Video » In this talk, I will introduce recent works on model fusion, a special case of Federated Learning where only a single communication round is allowed. This setting has a unique feature where it is sufficient for clients to have a pre-trained model, but not the data. Data storage regulations such as GDPR make this setting appealing as the data can be immediately deleted after updating the local model before FL starts. In addition to deep learning methods, I will cover unsupervised settings such as mixture models, topic models, and hidden Markov models. |
Mikhail Yurochkin 🔗 |
Sun 5:20 p.m. - 5:27 p.m.
|
Efficient, Legally Compliant Privacy-Preserving Federated Learning
(Privacy in FL: Lighning talk #1)
SlidesLive Video » |
Theodoros Salonidis 🔗 |
Sun 5:27 p.m. - 5:36 p.m.
|
Mechanisms for Privacy Preserving and Adversarial Training in Federated Learning
(Privacy in FL: Lighning talk #2)
SlidesLive Video » We present two work targeted at (i) preserving privacy of training data, and (ii) improving adversarial robustness of models, in federated learning (FL). Privacy of training data is key to FL. Model updates were assumed to be private for a long time, but recent reconstruction attacks (DLG,IDLG, IG) have demonstrated otherwise. Existing techniques for privacy preservation (encryption, secure multiparty computation and addition of statistical noise to model updates) are useful but have drawbacks -- either in terms of performance or model accuracy. We present recent work on effective use of model shuffling combined with trusted execution environments (TEEs) for aggregation. Adversarial training (AT) in the federated learning setting is challenging given limited communication budget and non-iid data distribution among. We propose FedDynAT, a novel algorithm for efficient AT in federated learning. FedDynAT builds on techniques proposed for preventing catastrophic forgetting in federated learning with non-iid data by augmenting them with a dynamic local AT schedule. FedDynAT improves the convergence time upto a factor 14x for limited communication budget and achieves high accuracy at convergence as compared to other state-of-the-art schemes. |
Parijat Dube · Jayaram Kallapalayam Radhakrishnan 🔗 |
Sun 5:36 p.m. - 5:43 p.m.
|
Governance in FL: Providing AI Fairness and Accountability
(Privacy in FL: Lighning talk #3)
SlidesLive Video » |
Nathalie Baracaldo · Ali Anwar · Annie Abay 🔗 |
Sun 5:43 p.m. - 5:50 p.m.
|
Live-action Demo with Audience Participation: Jointly train an FL model using algorithms presented in the lightning talks
(Demo)
SlidesLive Video » |
🔗 |
Sun 5:53 p.m. - 5:59 p.m.
|
Live Q&A with presenters
(Discussion and Q&A)
SlidesLive Video » |
🔗 |
Author Information
Laura Wynter (IBM Research)
Nathalie Baracaldo (IBM Research)
Chaitanya Kumar
Parijat Dube
Mikhail Yurochkin (IBM Research AI)
Theodoros Salonidis
Shiqiang Wang (IBM Research)
More from the Same Authors
-
2021 : Industrial Booth (IBM) »
Shiqiang Wang · Nathalie Baracaldo -
2022 Poster: Order Constraints in Optimal Transport »
Yu Chin Fabian Lim · Laura Wynter · Shiau Hong Lim -
2022 Spotlight: Order Constraints in Optimal Transport »
Yu Chin Fabian Lim · Laura Wynter · Shiau Hong Lim -
2022 Poster: Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Data »
Timothy Castiglia · Anirban Das · Shiqiang Wang · Stacy Patterson -
2022 Spotlight: Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Data »
Timothy Castiglia · Anirban Das · Shiqiang Wang · Stacy Patterson -
2022 Poster: Log-Euclidean Signatures for Intrinsic Distances Between Unaligned Datasets »
Tal Shnitzer · Mikhail Yurochkin · Kristjan Greenewald · Justin Solomon -
2022 Spotlight: Log-Euclidean Signatures for Intrinsic Distances Between Unaligned Datasets »
Tal Shnitzer · Mikhail Yurochkin · Kristjan Greenewald · Justin Solomon -
2021 : Closing Remarks »
Shiqiang Wang · Nathalie Baracaldo · Olivia Choudhury · Gauri Joshi · Peter Richtarik · Praneeth Vepakomma · Han Yu -
2021 : Industrial Panel »
Nathalie Baracaldo · Shiqiang Wang · Peter Kairouz · Zheng Xu · Kshitiz Malik · Tao Zhang -
2021 Workshop: International Workshop on Federated Learning for User Privacy and Data Confidentiality in Conjunction with ICML 2021 (FL-ICML'21) »
Nathalie Baracaldo · Olivia Choudhury · Gauri Joshi · Peter Richtarik · Praneeth Vepakomma · Shiqiang Wang · Han Yu -
2021 : Opening Remarks »
Shiqiang Wang · Nathalie Baracaldo · Olivia Choudhury · Gauri Joshi · Peter Richtarik · Praneeth Vepakomma · Han Yu -
2021 Poster: Outlier-Robust Optimal Transport »
Debarghya Mukherjee · Aritra Guha · Justin Solomon · Yuekai Sun · Mikhail Yurochkin -
2021 Spotlight: Outlier-Robust Optimal Transport »
Debarghya Mukherjee · Aritra Guha · Justin Solomon · Yuekai Sun · Mikhail Yurochkin -
2021 : Governance in FL: Providing AI Fairness and Accountability »
Nathalie Baracaldo · Ali Anwar · Annie Abay -
2021 : Mechanisms for Privacy Preserving and Adversarial Training in Federated Learning »
Parijat Dube · Jayaram Kallapalayam Radhakrishnan -
2021 : Efficient, Legally Compliant Privacy-Preserving Federated Learning »
Theodoros Salonidis -
2021 : Model fusion via single-round FL »
Mikhail Yurochkin -
2021 : Fed+ for robustness and personalization »
Laura Wynter -
2021 : Adaptive Federated Learning for Communication and Computation Efficiency (2021 IEEE Leonard Prize-winning work). »
Shiqiang Wang -
2020 : Closing remarks »
Nathalie Baracaldo · Olivia Choudhury · Gauri Joshi · Ramesh Raskar · Shiqiang Wang · Han Yu -
2020 : Opening remarks »
Nathalie Baracaldo · Olivia Choudhury · Gauri Joshi · Ramesh Raskar · Shiqiang Wang · Han Yu -
2020 Workshop: Federated Learning for User Privacy and Data Confidentiality »
Nathalie Baracaldo · Olivia Choudhury · Olivia Choudhury · Gauri Joshi · Ramesh Raskar · Gauri Joshi · Shiqiang Wang · Han Yu -
2020 Poster: Model Fusion with Kullback--Leibler Divergence »
Sebastian Claici · Mikhail Yurochkin · Soumya Ghosh · Justin Solomon -
2020 Poster: Two Simple Ways to Learn Individual Fairness Metrics from Data »
Debarghya Mukherjee · Mikhail Yurochkin · Moulinath Banerjee · Yuekai Sun -
2019 Poster: Bayesian Nonparametric Federated Learning of Neural Networks »
Mikhail Yurochkin · Mayank Agarwal · Soumya Ghosh · Kristjan Greenewald · Nghia Hoang · Yasaman Khazaeni -
2019 Oral: Bayesian Nonparametric Federated Learning of Neural Networks »
Mikhail Yurochkin · Mayank Agarwal · Soumya Ghosh · Kristjan Greenewald · Nghia Hoang · Yasaman Khazaeni