Timezone: »
Fairness and robustness are two important concerns for federated learning systems. In this work, we identify that robustness to data and model poisoning attacks and fairness, measured as the uniformity of performance across devices, are competing constraints in statistically heterogeneous networks. To address these constraints, we propose employing a simple, general framework for personalized federated learning, Ditto, that can inherently provide fairness and robustness benefits, and develop a scalable solver for it. Theoretically, we analyze the ability of Ditto to achieve fairness and robustness simultaneously on a class of linear problems. Empirically, across a suite of federated datasets, we show that Ditto not only achieves competitive performance relative to recent personalization methods, but also enables more accurate, robust, and fair models relative to state-of-the-art fair or robust baselines.
Author Information
Tian Li (Carnegie Mellon University)
Shengyuan Hu (Carnegie Mellon University)
Ahmad Beirami (Facebook AI)
Virginia Smith (Carnegie Mellon University)

Virginia Smith is an assistant professor in the Machine Learning Department at Carnegie Mellon University.
Related Events (a corresponding poster, oral, or spotlight)
-
2021 Poster: Ditto: Fair and Robust Federated Learning Through Personalization »
Wed. Jul 21st 04:00 -- 06:00 AM Room
More from the Same Authors
-
2021 : Private Multi-Task Learning: Formulation and Applications to Federated Learning »
Shengyuan Hu · Steven Wu · Virginia Smith -
2021 : FERMI: Fair Empirical Risk Minimization Via Exponential Rényi Mutual Information »
Andrew Lowy · Rakesh Pavan · Sina Baharlouei · Meisam Razaviyayn · Ahmad Beirami -
2022 Poster: Private Adaptive Optimization with Side information »
Tian Li · Manzil Zaheer · Sashank Jakkam Reddi · Virginia Smith -
2022 Spotlight: Private Adaptive Optimization with Side information »
Tian Li · Manzil Zaheer · Sashank Jakkam Reddi · Virginia Smith -
2021 Workshop: Information-Theoretic Methods for Rigorous, Responsible, and Reliable Machine Learning (ITR3) »
Ahmad Beirami · Flavio Calmon · Berivan Isik · Haewon Jeong · Matthew Nokleby · Cynthia Rush -
2021 : Opening Remarks »
Ahmad Beirami -
2021 Poster: Heterogeneity for the Win: One-Shot Federated Clustering »
Don Kurian Dennis · Tian Li · Virginia Smith -
2021 Spotlight: Heterogeneity for the Win: One-Shot Federated Clustering »
Don Kurian Dennis · Tian Li · Virginia Smith -
2019 : Poster Session »
Ivana Balazevic · Minae Kwon · Benjamin Lengerich · Amir Asiaee · Alex Lambert · Wenyu Chen · Yiming Ding · Carlos Florensa · Joseph E Gaudio · Yesmina Jaafra · Boli Fang · Ruoxi Wang · Tian Li · SWAMINATHAN GURUMURTHY · Andy Yan · Kubra Cilingir · Vithursan (Vithu) Thangarasa · Alexander Li · Ryan Lowe -
2019 Poster: A Kernel Theory of Modern Data Augmentation »
Tri Dao · Albert Gu · Alexander J Ratner · Virginia Smith · Christopher De Sa · Christopher Re -
2019 Oral: A Kernel Theory of Modern Data Augmentation »
Tri Dao · Albert Gu · Alexander J Ratner · Virginia Smith · Christopher De Sa · Christopher Re