Timezone: »
We characterize the differential privacy guarantees of privacy mechanisms in the large-composition regime, i.e., when a privacy mechanism is sequentially applied a large number of times to sensitive data. Via exponentially tilting the privacy loss random variable, we derive a new formula for the privacy curve expressing it as a contour integral over an integration path that runs parallel to the imaginary axis with a free real-axis intercept. Then, using the method of steepest descent from mathematical physics, we demonstrate that the choice of saddle-point as the real-axis intercept yields closed-form accurate approximations of the desired contour integral. This procedure---dubbed the saddle-point accountant (SPA)---yields a constant-time accurate approximation of the privacy curve. Theoretically, our results can be viewed as a refinement of both Gaussian Differential Privacy and the moments accountant method found in Rényi Differential Privacy. In practice, we demonstrate through numerical experiments that the SPA provides a precise approximation of privacy guarantees competitive with purely numerical-based methods (such as FFT-based accountants), while enjoying closed-form mathematical expressions.
Author Information
Wael Alghamdi (Harvard University)
Felipe Gomez (Harvard)
Shahab Asoodeh (Harvard)
Flavio Calmon (Harvard University)
Oliver Kosut (Arizona State University)
Lalitha Sankar (Arizona State University)
More from the Same Authors
-
2021 : Neural Network-based Estimation of the MMSE »
Mario Diaz · Peter Kairouz · Lalitha Sankar -
2021 : Realizing GANs via a Tunable Loss Function »
Gowtham Raghunath Kurri · Tyler Sypherd · Lalitha Sankar -
2022 : Fair Universal Representations using Adversarial Models »
Monica Welfert · Peter Kairouz · Jiachun Liao · Chong Huang · Lalitha Sankar -
2022 : AugLoss: A Robust, Reliable Methodology for Real-World Corruptions »
Kyle Otstot · John Kevin Cava · Tyler Sypherd · Lalitha Sankar -
2022 : Rashomon Capacity: Measuring Predictive Multiplicity in Probabilistic Classification »
Hsiang Hsu · Flavio Calmon -
2022 : Beyond Adult and COMPAS: Fairness in Multi-Class Prediction »
Wael Alghamdi · Hsiang Hsu · Haewon Jeong · Hao Wang · Peter Winston Michalak · Shahab Asoodeh · Flavio Calmon -
2023 : Arbitrary Decisions are a Hidden Cost of Differentially Private Training »
Bogdan Kulynych · Hsiang Hsu · Carmela Troncoso · Flavio Calmon -
2023 : Fair Machine Unlearning: Data Removal while Mitigating Disparities »
Alex Oesterling · Jiaqi Ma · Flavio Calmon · Hima Lakkaraju -
2023 : Tunable Dual-Objective GANs for Stable Training »
Monica Welfert · Kyle Otstot · Gowtham Kurri · Lalitha Sankar -
2022 Poster: Being Properly Improper »
Tyler Sypherd · Richard Nock · Lalitha Sankar -
2022 Spotlight: Being Properly Improper »
Tyler Sypherd · Richard Nock · Lalitha Sankar -
2021 : Invited Talk: Lalitha Sankar »
Lalitha Sankar -
2021 Workshop: Information-Theoretic Methods for Rigorous, Responsible, and Reliable Machine Learning (ITR3) »
Ahmad Beirami · Flavio Calmon · Berivan Isik · Haewon Jeong · Matthew Nokleby · Cynthia Rush -
2020 Poster: Predictive Multiplicity in Classification »
Charles Marx · Flavio Calmon · Berk Ustun -
2019 Poster: Repairing without Retraining: Avoiding Disparate Impact with Counterfactual Distributions »
Hao Wang · Berk Ustun · Flavio Calmon -
2019 Oral: Repairing without Retraining: Avoiding Disparate Impact with Counterfactual Distributions »
Hao Wang · Berk Ustun · Flavio Calmon