Timezone: »
In modern ML domains, state-of-the-art performance is attained by highly overparameterized models that are expensive to train, costing weeks of time and millions of dollars. At the same time, after deploying the model, the learner may realize issues such as leakage of private data or vulnerability to adversarial examples. The learner may also wish to impose additional constraints post-deployment, for example, to ensure fairness for different subgroups. Retraining the model from scratch to incorporate additional desiderata would be expensive. As a consequence, one would instead prefer to update the model, which can yield significant savings of resources such as time, computation, and memory over retraining from scratch. Some instances of this principle in action include the emerging field of machine unlearning, and the celebrated paradigm of fine-tuning pretrained models. The goal of our workshop is to provide a platform to stimulate discussion about both the state-of-the-art in updatable ML and future challenges in the field.
Sat 5:55 a.m. - 2:30 p.m.
|
Please visit the workshop website for the full program ( Program ) link » | 🔗 |
Sat 5:55 a.m. - 6:00 a.m.
|
Opening Remarks
(
Talk
)
SlidesLive Video » |
🔗 |
Sat 6:00 a.m. - 6:30 a.m.
|
Or Zamir: Planting undetectable backdoors in Machine Learning models
(
Invited Speaker
)
SlidesLive Video » |
🔗 |
Sat 6:30 a.m. - 7:00 a.m.
|
Aaron Roth: An Algorithmic Framework for Bias Bounties
(
Invited Speaker
)
SlidesLive Video » |
🔗 |
Sat 7:00 a.m. - 7:30 a.m.
|
Short Break
|
🔗 |
Sat 7:30 a.m. - 8:30 a.m.
|
Spotlight talks 1
(
Short talks
)
SlidesLive Video » Spotlight talks 1 From Adaptive Query Release to Machine Unlearning Enayat Ullah, Raman Arora Geometric Alignment Improves Fully Test Time Adaptation Kowshik Thopalli, Pavan K. Turaga, Jayaraman J. Thiagarajan Modeling the Right to Be Forgotten Aloni Cohen, Adam Smith, Marika Swanberg, Prashant Nalini Vasudevan Revisiting the Updates of a Pre-trained Model for Few-shot Learning Yujin Kim, Jaehoon Oh, Sungnyun Kim, Se-Young Yun Super Seeds: extreme model compression by trading off storage with computation Nayoung Lee, Shashank Rajput, Jy-yong Sohn, Hongyi Wang, Alliot Nagle, Eric Xing, Kangwook Lee, Dimitris Papailiopoulos (*: equal contribution) Beyond Tabula Rasa: Reincarnating Reinforcement Learning Rishabh Agarwal, Max Schwarzer, Pablo Samuel Castro, Aaron Courville, Marc G Bellemare |
🔗 |
Sat 8:30 a.m. - 9:00 a.m.
|
Chelsea Finn: Adapting Deep Networks to Distribution Shift with Minimal Assumptions
(
Invited Speaker
)
SlidesLive Video » |
🔗 |
Sat 9:00 a.m. - 10:30 a.m.
|
Lunch Break
Lunch on your own |
🔗 |
Sat 10:30 a.m. - 11:00 a.m.
|
Nicolas Papernot: What does it mean to unlearn?
(
Invited Speaker
)
SlidesLive Video » |
🔗 |
Sat 11:00 a.m. - 11:30 a.m.
|
Zico Kolter: Test-time adaptation via the convex conjugate
(
Invited Speaker
)
SlidesLive Video » |
🔗 |
Sat 11:30 a.m. - 12:00 p.m.
|
Spotlight talks 2
(
Short talks
)
SlidesLive Video » Simulating Bandit Learning from User Feedback for Extractive Question Answering Ge Gao, Eunsol Choi, Yoav Artzi How Adaptive are Adaptive Test-time Defenses? Francesco Croce, Sven Gowal, Thomas Brunner, Evan Shelhamer, Matthias Hein, Ali Taylan Cemgil Comparing Model and Input Updates for Test-Time Adaptation to Corruption Jin Gao, Jialing Zhang, Xihui Liu, Trevor Darrell, Evan Shelhamer, Dequan Wang |
🔗 |
Sat 12:00 p.m. - 12:30 p.m.
|
Break
|
🔗 |
Sat 12:30 p.m. - 2:30 p.m.
|
Poster session
|
🔗 |
Author Information
Ayush Sekhari (Cornell University)
Gautam Kamath (University of Waterloo)
Jayadev Acharya (Cornell University)
More from the Same Authors
-
2021 : Enabling Fast Differentially Private SGD via Just-in-Time Compilation and Vectorization »
Pranav Subramani · Nicholas Vadivelu · Gautam Kamath -
2021 : Remember What You Want to Forget: Algorithms for Machine Unlearning »
Ayush Sekhari · Ayush Sekhari · Jayadev Acharya · Gautam Kamath · Ananda Theertha Suresh -
2021 : The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection »
Shubhankar Mohapatra · Shubhankar Mohapatra · Sajin Sasy · Gautam Kamath · Xi He · Om Dipakbhai Thakkar -
2021 : Unbiased Statistical Estimation and Valid Confidence Sets Under Differential Privacy »
Christian Covington · Xi He · James Honaker · Gautam Kamath -
2021 : Improved Rates for Differentially Private Stochastic Convex Optimization with Heavy-Tailed Data »
Gautam Kamath · Xingtu Liu · Huanyu Zhang -
2023 Poster: Exploring the Limits of Indiscriminate Data Poisoning Attacks »
Yiwei Lu · Gautam Kamath · Yaoliang Yu -
2023 Poster: Computationally Efficient PAC RL in POMDPs with Latent Determinism and Conditional Embeddings »
Masatoshi Uehara · Ayush Sekhari · Jason Lee · Nathan Kallus · Wen Sun -
2022 Workshop: Theory and Practice of Differential Privacy »
Gautam Kamath · Audra McMillan -
2022 Poster: Improved Rates for Differentially Private Stochastic Convex Optimization with Heavy-Tailed Data »
Gautam Kamath · Xingtu Liu · Huanyu Zhang -
2022 Poster: Guarantees for Epsilon-Greedy Reinforcement Learning with Function Approximation »
Chris Dann · Yishay Mansour · Mehryar Mohri · Ayush Sekhari · Karthik Sridharan -
2022 Oral: Improved Rates for Differentially Private Stochastic Convex Optimization with Heavy-Tailed Data »
Gautam Kamath · Xingtu Liu · Huanyu Zhang -
2022 Spotlight: Guarantees for Epsilon-Greedy Reinforcement Learning with Function Approximation »
Chris Dann · Yishay Mansour · Mehryar Mohri · Ayush Sekhari · Karthik Sridharan -
2021 Workshop: Theory and Practice of Differential Privacy »
Rachel Cummings · Gautam Kamath -
2021 : Opening Remarks »
Gautam Kamath · Rachel Cummings -
2021 Poster: PAPRIKA: Private Online False Discovery Rate Control »
Wanrong Zhang · Gautam Kamath · Rachel Cummings -
2021 Poster: Robust Testing and Estimation under Manipulation Attacks »
Jayadev Acharya · Ziteng Sun · Huanyu Zhang -
2021 Poster: Principal Bit Analysis: Autoencoding with Schur-Concave Loss »
Sourbh Bhadane · Aaron Wagner · Jayadev Acharya -
2021 Spotlight: Principal Bit Analysis: Autoencoding with Schur-Concave Loss »
Sourbh Bhadane · Aaron Wagner · Jayadev Acharya -
2021 Spotlight: PAPRIKA: Private Online False Discovery Rate Control »
Wanrong Zhang · Gautam Kamath · Rachel Cummings -
2021 Spotlight: Robust Testing and Estimation under Manipulation Attacks »
Jayadev Acharya · Ziteng Sun · Huanyu Zhang -
2020 Poster: Privately Learning Markov Random Fields »
Huanyu Zhang · Gautam Kamath · Janardhan Kulkarni · Steven Wu -
2020 Poster: Context Aware Local Differential Privacy »
Jayadev Acharya · Kallista Bonawitz · Peter Kairouz · Daniel Ramage · Ziteng Sun -
2019 Poster: Communication-Constrained Inference and the Role of Shared Randomness »
Jayadev Acharya · Clément Canonne · Himanshu Tyagi -
2019 Oral: Communication-Constrained Inference and the Role of Shared Randomness »
Jayadev Acharya · Clément Canonne · Himanshu Tyagi -
2019 Poster: Sever: A Robust Meta-Algorithm for Stochastic Optimization »
Ilias Diakonikolas · Gautam Kamath · Daniel Kane · Jerry Li · Jacob Steinhardt · Alistair Stewart -
2019 Poster: Distributed Learning with Sublinear Communication »
Jayadev Acharya · Christopher De Sa · Dylan Foster · Karthik Sridharan -
2019 Oral: Sever: A Robust Meta-Algorithm for Stochastic Optimization »
Ilias Diakonikolas · Gautam Kamath · Daniel Kane · Jerry Li · Jacob Steinhardt · Alistair Stewart -
2019 Oral: Distributed Learning with Sublinear Communication »
Jayadev Acharya · Christopher De Sa · Dylan Foster · Karthik Sridharan -
2019 Poster: Communication Complexity in Locally Private Distribution Estimation and Heavy Hitters »
Jayadev Acharya · Ziteng Sun -
2019 Oral: Communication Complexity in Locally Private Distribution Estimation and Heavy Hitters »
Jayadev Acharya · Ziteng Sun -
2018 Poster: INSPECTRE: Privately Estimating the Unseen »
Jayadev Acharya · Gautam Kamath · Ziteng Sun · Huanyu Zhang -
2018 Oral: INSPECTRE: Privately Estimating the Unseen »
Jayadev Acharya · Gautam Kamath · Ziteng Sun · Huanyu Zhang -
2017 Poster: Priv’IT: Private and Sample Efficient Identity Testing »
Bryan Cai · Constantinos Daskalakis · Gautam Kamath -
2017 Poster: Being Robust (in High Dimensions) Can Be Practical »
Ilias Diakonikolas · Gautam Kamath · Daniel Kane · Jerry Li · Ankur Moitra · Alistair Stewart -
2017 Talk: Priv’IT: Private and Sample Efficient Identity Testing »
Bryan Cai · Constantinos Daskalakis · Gautam Kamath -
2017 Talk: Being Robust (in High Dimensions) Can Be Practical »
Ilias Diakonikolas · Gautam Kamath · Daniel Kane · Jerry Li · Ankur Moitra · Alistair Stewart -
2017 Poster: A Unified Maximum Likelihood Approach for Estimating Symmetric Properties of Discrete Distributions »
Jayadev Acharya · Hirakendu Das · Alon Orlitsky · Ananda Suresh -
2017 Talk: A Unified Maximum Likelihood Approach for Estimating Symmetric Properties of Discrete Distributions »
Jayadev Acharya · Hirakendu Das · Alon Orlitsky · Ananda Suresh