Workshop
Challenges in Deployable Generative AI
Swami Sankaranarayanan · Thomas Hartvigsen · Camille Bilodeau · Ryutaro Tanno · Cheng Zhang · Florian Tramer · Phillip Isola
Meeting Room 313
Fri 28 Jul, noon PDT
Generative modeling has recently gained massive attention given high-profile successes in natural language processing and computer vision. However, there remain major challenges in deploying generative models for real-world impact in domains like healthcare and biology. This is a challenging agenda that requires collaboration across multiple research fields and industry stakeholders. This workshop aims to advance such interdisciplinary conversations around challenges in deploying generative models – the lessons learned by deploying large language models could be impactful for high stakes domains like medicine and biology. Specifically, we will solicit contributions that prioritize (1) Multimodal capabilities in generative modeling, (2) Deployment-critical features in generative models such as Safety, Interpretability, Robustness, Ethics, Fairness and Privacy, and (3) Human facing evaluation of generative models. The topic of generative modeling is extremely relevant to the core audience of ICML. Modern generative models impact several fields outside machine learning and hence responsible deployment of such powerful algorithms has become a major concern of researchers in academia and industry alike. ICML, being the flagship conference of Machine learning, is the perfect place to facilitate this cross disciplinary sharing of knowledge.
Schedule
Fri 12:00 p.m. - 12:05 p.m.
|
Opening Remarks
(
Introductory Remarks
)
>
SlidesLive Video |
🔗 |
Fri 12:05 p.m. - 12:30 p.m.
|
Talk: Tim Salimans, Google Research
(
Virtual Talk
)
>
SlidesLive Video |
🔗 |
Fri 12:30 p.m. - 12:55 p.m.
|
Talk: Olga Russakovsky, Princeton University
(
Virtual Talk
)
>
SlidesLive Video |
🔗 |
Fri 12:55 p.m. - 1:20 p.m.
|
Talk: Alan Aspuru-Guzik, University of Toronto
(
Virtual Talk
)
>
SlidesLive Video |
🔗 |
Fri 1:20 p.m. - 1:45 p.m.
|
Talk: Pamela Mishkin, OpenAI
(
Virtual Talk
)
>
SlidesLive Video |
🔗 |
Fri 1:45 p.m. - 2:00 p.m.
|
Coffee Break
|
🔗 |
Fri 2:00 p.m. - 3:00 p.m.
|
Poster Session I
(
Poster presentations
)
>
|
🔗 |
Fri 3:00 p.m. - 4:00 p.m.
|
Lunch
|
🔗 |
Fri 4:00 p.m. - 4:30 p.m.
|
Talk: Deep Ganguli, Anthropic
(
In-person talk
)
>
SlidesLive Video |
🔗 |
Fri 4:30 p.m. - 5:00 p.m.
|
Talk: Finale Doshi-Velez, Harvard University
(
In-person talk
)
>
SlidesLive Video |
🔗 |
Fri 5:00 p.m. - 5:30 p.m.
|
Talk: Daphne Ippolito, Carnegie Mellon University
(
In-person talk
)
>
SlidesLive Video |
🔗 |
Fri 5:30 p.m. - 6:00 p.m.
|
Talk: Kyunghyun Cho, NYU / Genentech
(
In-person talk
)
>
SlidesLive Video |
🔗 |
Fri 6:10 p.m. - 7:00 p.m.
|
Poster Session II
(
Poster presentations
)
>
|
🔗 |
Fri 7:00 p.m. - 7:55 p.m.
|
Panel Discussion: “Challenges and lessons learned in deploying Generative AI”
(
Discussion Panel
)
>
SlidesLive Video |
🔗 |
Fri 7:55 p.m. - 8:00 p.m.
|
Closing Remarks
(
Concluding Remarks
)
>
SlidesLive Video |
🔗 |
-
|
A comparison of diffusion models and CycleGANs for virtual staining of slide-free microscopy images ( Poster ) > link | Tanishq Abraham · Richard Levenson 🔗 |
-
|
Temporal Attention Bottleneck is informative? Interpretability through Disentangled Generative Representations for Energy Time Series Disaggregation ( Poster ) > link | khalid OUBLAL · Said Ladjal · David Benhaiem · Emmanuel le-borgne · François Roueff 🔗 |
-
|
Conditional Diffusion Replay for Continual Learning in Medical Settings ( Poster ) > link | Yewon Byun · Saurabh Garg · Sanket Vaibhav Mehta · Praveer Singh · Jayashree Kalpathy-cramer · Bryan Wilder · Zachary Lipton 🔗 |
-
|
Deep Generative Clustering with Multimodal Variational Autoencoders ( Poster ) > link | Emanuele Palumbo · Sonia Laguna · Daphné Chopard · Julia Vogt 🔗 |
-
|
Do Users Write More Insecure Code with AI Assistants? ( Poster ) > link | Neil Perry · Megha Srivastava · Deepak Kumar · Dan Boneh 🔗 |
-
|
Risk-Aware Image Generation by Estimating and Propagating Uncertainty ( Poster ) > link | Alejandro Perez · Iaroslav Elistratov · Fynn Schmitt-Ulms · Ege Demir · Sadhana Lolla · Elaheh Ahmadi · Daniela Rus · Alexander Amini 🔗 |
-
|
Answering Causal Questions with Augmented LLMs ( Poster ) > link | Nick Pawlowski · Joel Jennings · Cheng Zhang 🔗 |
-
|
Circuit Breaking: Removing Model Behaviors with Targeted Ablation ( Poster ) > link | Maximilian Li · Xander Davies · Max Nadeau 🔗 |
-
|
LLM-Based Aspect Augmentations for Recommendation Systems ( Poster ) > link | Reza Yousefi Maragheh · LALITESH MORISHETTI · Ramin Giahi · Kaushiki Nag · Jianpeng Xu · Jason Cho · Evren Korpeoglu · Sushant Kumar · Kannan Achan 🔗 |
-
|
Can Public Large Language Models Help Private Cross-device Federated Learning? ( Poster ) > link | Boxin Wang · Yibo J. Zhang · Yuan Cao · Bo Li · Hugh B McMahan · Sewoong Oh · Zheng Xu · Manzil Zaheer 🔗 |
-
|
Soft prompting might be a bug, not a feature ( Poster ) > link | Luke Bailey · Gustaf Ahdritz · Anat Kleiman · Siddharth Swaroop · Finale Doshi-Velez · Weiwei Pan 🔗 |
-
|
(Un)interpretability of Transformers: a case study with Dyck grammars ( Poster ) > link | Kaiyue Wen · Yuchen Li · Bingbin Liu · Andrej Risteski 🔗 |
-
|
Discovering Variable Binding Circuitry with Desiderata ( Poster ) > link | Xander Davies · Max Nadeau · Nikhil Prakash · Tamar Shaham · David Bau 🔗 |
-
|
Decision Stacks: Flexible Reinforcement Learning via Modular Generative Models ( Poster ) > link | Siyan Zhao · Aditya Grover 🔗 |
-
|
Generative Autoencoders as Watermark Attackers: Analyses of Vulnerabilities and Threats ( Poster ) > link | Xuandong Zhao · Kexun Zhang · Yu-Xiang Wang · Lei Li 🔗 |
-
|
The Journey, Not the Destination: How Data Guides Diffusion Models ( Poster ) > link | Kristian Georgiev · Joshua Vendrow · Hadi Salman · Sung Min (Sam) Park · Aleksander Madry 🔗 |
-
|
One-Step Diffusion Distillation via Deep Equilibrium Models ( Poster ) > link | Zhengyang Geng · Ashwini Pokle · Zico Kolter 🔗 |
-
|
Seeing Through the Facade: Understanding the Realism, Expressivity, and Limitations of Diffusion Models ( Poster ) > link | Christopher Pondoc · Joseph O'Brien · Joseph Guman 🔗 |
-
|
Local Differential Privacy with Entropic Wasserstein Distance ( Poster ) > link | Daria Reshetova · Wei-Ning Chen · Ayfer Ozgur 🔗 |
-
|
Provable Robust Watermarking for AI-Generated Text ( Poster ) > link | Xuandong Zhao · Prabhanjan Ananth · Lei Li · Yu-Xiang Wang 🔗 |
-
|
Exposing Attention Glitches with Flip-Flop Language Modeling ( Poster ) > link | Bingbin Liu · Jordan Ash · Surbhi Goel · Akshay Krishnamurthy · Cyril Zhang 🔗 |
-
|
Calibrating Language Models via Augmented Prompt Ensembles ( Poster ) > link | Mingjian Jiang · Yangjun Ruan · Sicong Huang · Saifei Liao · Silviu Pitis · Roger Grosse · Jimmy Ba 🔗 |
-
|
Adapting Blackbox Generative Models via Inversion ( Poster ) > link | Sinjini Mitra · Rakshith Subramanyam · Rushil Anirudh · Jayaraman J. Thiagarajan · Ankita Shukla · Pavan Turaga 🔗 |
-
|
Leaving Reality to Imagination: Robust Classification via Generated Datasets ( Poster ) > link | Hritik Bansal · Aditya Grover 🔗 |
-
|
Beyond Scale: the Diversity Coefficient as a Data Quality Metric Demonstrates LLMs are Pre-trained on Formally Diverse Data ( Poster ) > link | Alycia Lee · Brando Miranda · Sanmi Koyejo 🔗 |
-
|
Differentially Private Generation of High Fidelity Samples From Diffusion Models ( Poster ) > link | Vikash Sehwag · Ashwinee Panda · Ashwini Pokle · Xinyu Tang · Saeed Mahloujifar · Mung Chiang · Zico Kolter · Prateek Mittal 🔗 |
-
|
Towards Safe Self-Distillation of Internet-Scale Text-to-Image Diffusion Models ( Poster ) > link | Sanghyun Kim · Seohyeon Jung · Balhae Kim · Moonseok Choi · Jinwoo Shin · Juho Lee 🔗 |
-
|
DisasterResponseGPT: Large Language Models for Accelerated Plan of Action Development in Disaster Response Scenarios ( Poster ) > link | Vinicius G. Goecks · Nicholas Waytowich 🔗 |
-
|
Identifying Implicit Social Biases in Vision-Language Models ( Poster ) > link | Kimia Hamidieh · Haoran Zhang · Thomas Hartvigsen · Marzyeh Ghassemi 🔗 |
-
|
Analyzing Chain-of-Thought Prompting in Large Language Models via Gradient-based Feature Attributions ( Poster ) > link | Skyler Wu · Eric Shen · Charumathi Badrinath · Jiaqi Ma · Himabindu Lakkaraju 🔗 |
-
|
A Demand-Driven Perspective on Generative Audio AI ( Poster ) > link | Sangshin Oh · Minsung Kang · Hyeongi Moon · Keunwoo Choi · Ben Sangbae Chon 🔗 |
-
|
Predicting Task Forgetting in Large Language Models ( Poster ) > link | Anat Kleiman · Jonathan Frankle · Sham Kakade · Mansheej Paul 🔗 |
-
|
Understanding Data Replication in Diffusion Models ( Poster ) > link | Gowthami Somepalli · Vasu Singla · Micah Goldblum · Jonas Geiping · Tom Goldstein 🔗 |
-
|
AutoBiasTest: Controllable Test Sentence Generation for Open-Ended Social Bias Testing in Language Models at Scale ( Poster ) > link | Rafal Kocielnik · Shrimai Prabhumoye · Vivian Zhang · R. Alvarez · Anima Anandkumar 🔗 |
-
|
Word-Level Explanations for Analyzing Bias in Text-to-Image Models ( Poster ) > link | Alexander Lin · Lucas Monteiro Paes · Sree Harsha Tanneru · Suraj Srinivas · Himabindu Lakkaraju 🔗 |
-
|
Squeezing Large-Scale Diffusion Models for Mobile ( Poster ) > link | Jiwoong Choi · Minkyu Kim · Daehyun Ahn · Taesu Kim · Yulhwa Kim · Dongwon Jo · Hyesung Jeon · jae-joon kim · Hyungjun Kim 🔗 |
-
|
MargCTGAN: A ``Marginally'' Better CTGAN for the Low Sample Regime ( Poster ) > link | Tejumade Afonja · Dingfan Chen · Mario Fritz 🔗 |
-
|
On the Challenges of Deploying Privacy-Preserving Synthetic Data in the Enterprise ( Poster ) > link | Lauren Arthur · Jason Costello · Jonathan Hardy · Will O’Brien · James Rea · Gareth Rees · Georgi Ganev 🔗 |
-
|
Neuro-Symbolic Models of Human Moral Judgment: LLMs as Automatic Feature Extractors ( Poster ) > link | joseph kwon · Sydney Levine · Josh Tenenbaum 🔗 |
-
|
Tree Variational Autoencoders ( Poster ) > link | Laura Manduchi · Moritz Vandenhirtz · Alain Ryser · Julia Vogt 🔗 |
-
|
Mitigating Inappropriateness in Image Generation: Can there be Value in Reflecting the Worlds Ugliness? ( Poster ) > link | Manuel Brack · Felix Friedrich · Patrick Schramowski · Kristian Kersting 🔗 |
-
|
RustGen: An Augmentation Approach for Generating Compilable Rust Code with Large Language Models ( Poster ) > link | Xingbo Wu · Nathanaël Cheriere · Cheng Zhang · Dushyanth Narayanan 🔗 |
-
|
E3-VITS: Emotional End-to-End TTS with Cross-speaker Style Transfer ( Poster ) > link | Wonbin Jung · Junhyeok Lee 🔗 |
-
|
Are Emergent Abilities of Large Language Models a Mirage? ( Poster ) > link | Rylan Schaeffer · Brando Miranda · Sanmi Koyejo 🔗 |
-
|
Seeing Seeds Beyond Weeds: Green Teaming Generative AI for Beneficial Uses ( Poster ) > link | Logan Stapleton · Jordan Taylor · Sarah Fox · Sherry Tongshuang Wu · Haiyi Zhu 🔗 |
-
|
Continual Learning for Forgetting in Deep Generative Models ( Poster ) > link | Alvin Heng · Harold Soh 🔗 |
-
|
Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task ( Poster ) > link | Maya Okawa · Ekdeep Singh Lubana · Robert Dick · Hidenori Tanaka 🔗 |
-
|
Functional Renyi Differential Privacy for Generative Modeling ( Poster ) > link | Dihong Jiang · Sun Sun · Yaoliang Yu 🔗 |
-
|
DP-LFlow: Differentially Private Latent Flow for Scalable Sensitive Image Generation ( Poster ) > link | Dihong Jiang · Sun Sun 🔗 |
-
|
Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models’ Reasoning Performance ( Poster ) > link | Yao Fu · Litu Ou · Yuhao Wan · Mingyu Chen · Hao Peng · Tushar Khot 🔗 |
-
|
Surely You’re Lying, Mr. Model: Improving and Analyzing CCS ( Poster ) > link | Naomi Bashkansky · Chloe Loughridge · Chuyue Tang 🔗 |
-
|
Ensuring Visual Commonsense Morality for Text-to-Image Generation ( Poster ) > link | Seongbeom Park · Suhong Moon · Jinkyu Kim 🔗 |
-
|
Concept Bottleneck Generative Models ( Poster ) > link | Aya Ismail · Julius Adebayo · Hector Corrada Bravo · Stephen Ra · Kyunghyun Cho 🔗 |
-
|
Language Model Tokenizers Introduce Unfairness Between Languages ( Poster ) > link | Aleksandar Petrov · Emanuele La Malfa · Phil Torr · Adel Bibi 🔗 |
-
|
CLAM: Selective Clarification for Ambiguous Questions with Generative Language Models ( Poster ) > link | Lorenz Kuhn · Yarin Gal · Sebastian Farquhar 🔗 |
-
|
The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion ( Poster ) > link | Yujin Jeong · Wonjeong Ryoo · Seung Hyun Lee · Da Bin Seo · Wonmin Byeon · Sangpil Kim · Jinkyu Kim 🔗 |
-
|
Large Language Models for Code: Security Hardening and Adversarial Testing ( Poster ) > link | Jingxuan He · Martin Vechev 🔗 |
-
|
TRAC: Trustworthy Retrieval Augmented Chatbot ( Poster ) > link | Shuo Li · Sangdon Park · Insup Lee · Osbert Bastani 🔗 |
-
|
Evaluation Metrics for Protein Structure Generation ( Poster ) > link | Josh Southern · Arne Schneuing · Michael Bronstein · Bruno Correia 🔗 |
-
|
De-stereotyping Text-to-image Models through Prompt Tuning ( Poster ) > link | Eunji Kim · Siwon Kim · Chaehun Shin · Sungroh Yoon 🔗 |
-
|
Using Synthetic Data for Data Augmentation to Improve Classification Accuracy ( Poster ) > link | Yongchao Zhou · Hshmat Sahak · Jimmy Ba 🔗 |
-
|
Goal-conditioned GFlowNets for Controllable Multi-Objective Molecular Design ( Poster ) > link | Julien Roy · Pierre-Luc Bacon · Christopher Pal · Emmanuel Bengio 🔗 |
-
|
The Unseen A+ Student: Navigating the Impact of Large Language Models in the Classroom ( Poster ) > link | Matyáš Boháček 🔗 |
-
|
Interpolating between Images with Diffusion Models ( Poster ) > link | Clinton Wang · Polina Golland 🔗 |