Timezone: »
We show that adding differential privacy to Explainable Boosting Machines (EBMs), a recent method for training interpretable ML models, yields state-of-the-art accuracy while protecting privacy. Our experiments on multiple classification and regression datasets show that DP-EBM models suffer surprisingly little accuracy loss even with strong differential privacy guarantees. In addition to high accuracy, two other benefits of applying DP to EBMs are: a) trained models provide exact global and local interpretability, which is often important in settings where differential privacy is needed; and b) the models can be edited after training without loss of privacy to correct errors which DP noise may have introduced.
Author Information
Harsha Nori (Microsoft)
Rich Caruana (Microsoft)
Zhiqi Bu (University of Pennsylvania)
Judy Hanwen Shen (Stanford)
Janardhan Kulkarni (Microsoft Research)
Related Events (a corresponding poster, oral, or spotlight)
-
2021 Spotlight: Accuracy, Interpretability, and Differential Privacy via Explainable Boosting »
Thu. Jul 22nd 01:45 -- 01:50 PM Room
More from the Same Authors
-
2021 : MISNN: Multiple Imputation via Semi-parametric Neural Networks »
Zhiqi Bu · Zongyu Dai · Yiliang Zhang · Qi Long -
2021 : Differentially Private Bayesian Neural Network »
Zhiqi Bu · Qiyiwen Zhang · Kan Chen · Qi Long -
2021 : On the Convergence of Deep Learning with Differential Privacy »
Zhiqi Bu · Hua Wang · Qi Long · Weijie Su -
2023 Poster: Differentially Private Optimization on Large Model at Small Cost »
Zhiqi Bu · Yu-Xiang Wang · Sheng Zha · George Karypis -
2022 : Invited talk #3 Rich Caruana. Talk Title: Friends Don’t Let Friends Deploy Black-Box Models: The Importance of Intelligibility in Machine Learning for Healthcare »
Rich Caruana -
2021 : MISNN: Multiple Imputation via Semi-parametric Neural Networks »
Qi Long · Yiliang Zhang · Zongyu Dai · Zhiqi Bu -
2021 Poster: Differentially Private Correlation Clustering »
Mark Bun · Marek Elias · Janardhan Kulkarni -
2021 Spotlight: Differentially Private Correlation Clustering »
Mark Bun · Marek Elias · Janardhan Kulkarni -
2020 : Invited Talk: What Interpretable Machine Learning Can Tell Us About Missing Values »
Rich Caruana -
2020 Poster: Differentially Private Set Union »
Sivakanth Gopi · Pankaj Gulhane · Janardhan Kulkarni · Judy Hanwen Shen · Milad Shokouhi · Sergey Yekhanin -
2019 : Tricks of Trade 2 (Rich Caruana) »
Rich Caruana -
2019 : Tricks of the Trade 1 (Rich Caruana) »
Rich Caruana -
2019 Workshop: Adaptive and Multitask Learning: Algorithms & Systems »
Maruan Al-Shedivat · Anthony Platanios · Otilia Stretcu · Jacob Andreas · Ameet Talwalkar · Rich Caruana · Tom Mitchell · Eric Xing -
2019 : Poster Session 1 (all papers) »
Matilde Gargiani · Yochai Zur · Chaim Baskin · Evgenii Zheltonozhskii · Liam Li · Ameet Talwalkar · Xuedong Shang · Harkirat Singh Behl · Atilim Gunes Baydin · Ivo Couckuyt · Tom Dhaene · Chieh Lin · Wei Wei · Min Sun · Orchid Majumder · Michele Donini · Yoshihiko Ozaki · Ryan P. Adams · Christian Geißler · Ping Luo · zhanglin peng · · Ruimao Zhang · John Langford · Rich Caruana · Debadeepta Dey · Charles Weill · Xavi Gonzalvo · Scott Yang · Scott Yak · Eugen Hotaj · Vladimir Macko · Mehryar Mohri · Corinna Cortes · Stefan Webb · Jonathan Chen · Martin Jankowiak · Noah Goodman · Aaron Klein · Frank Hutter · Mojan Javaheripi · Mohammad Samragh · Sungbin Lim · Taesup Kim · SUNGWOONG KIM · Michael Volpp · Iddo Drori · Yamuna Krishnamurthy · Kyunghyun Cho · Stanislaw Jastrzebski · Quentin de Laroussilhe · Mingxing Tan · Xiao Ma · Neil Houlsby · Andrea Gesmundo · Zalán Borsos · Krzysztof Maziarz · Felipe Petroski Such · Joel Lehman · Kenneth Stanley · Jeff Clune · Pieter Gijsbers · Joaquin Vanschoren · Felix Mohr · Eyke Hüllermeier · Zheng Xiong · Wenpeng Zhang · Wenwu Zhu · Weijia Shao · Aleksandra Faust · Michal Valko · Michael Y Li · Hugo Jair Escalante · Marcel Wever · Andrey Khorlin · Tara Javidi · Anthony Francis · Saurajit Mukherjee · Jungtaek Kim · Michael McCourt · Saehoon Kim · Tackgeun You · Seungjin Choi · Nicolas Knudde · Alexander Tornede · Ghassen Jerfel