Workshop
ICML 2024 Workshop on Foundation Models in the Wild
Xinyu Yang 路 Bilge Acun 路 Kamalika Chaudhuri 路 Beidi Chen 路 Giulia Fanti 路 Junlin Han 路 Lianhui Qin 路 Shengbang Tong 路 Phil Torr 路 Hao Wang 路 Cathy Wu 路 Huaxiu Yao 路 James Zou
Straus 1
Fri 26 Jul, midnight PDT
In the era of AI-driven transformations, foundation models (FMs), like large-scale language and vision models, have become pivotal in various applications, from natural language processing to computer vision. These models, with their immense capabilities, reshape the future of scientific research and the broader human society, but also introduce challenges in their in-the-wild/real-world deployments. The Workshop on FMs in the wild delves into the urgent need for these models to be useful when deployed in our societies. The significance of this topic cannot be overstated, as the real-world implications of these models impact everything from daily information access to critical decision-making in fields like medicine and finance. Stakeholders, from developers to end-users, care deeply about this because the successful integration of FMs into in-the-wild frameworks necessitates a careful consideration of adaptivity, reliability and efficiency. Some of the fundamental questions that this workshop aims to address are:\textbf{1. Real-world Adaptation:} In practical applications, how can we leverage the comprehensive knowledge in FMs to adapt them for specific domains, such as drug discovery, education, or clinical health?\textbf{2. Reliability and Responsibility:} How can foundation models work reliably outside their training distribution? And how can we address issues like hallucination and privacy?\textbf{3. Safety, Ethics, and Fairness in Society:} How do we ensure that the deployment of FMs preserving safety, ethics, and fairness within society, safeguarding against biases and unethical use?\textbf{4. Practical Limitations in Deployment:} How can FMs tackle challenges in practical applications, such as system constraints, computational costs, data acquisition barriers, response time demands?
Chat is not available.
Timezone: America/Los_Angeles
Schedule
Fri 12:00 a.m. - 12:05 a.m.
|
Introduction and opening remarks
SlidesLive Video |
馃敆 |
Fri 12:05 a.m. - 12:30 a.m.
|
Invited Talk 1: Dakuo Wang
SlidesLive Video |
馃敆 |
Fri 12:30 a.m. - 1:00 a.m.
|
Invited Talk 2: David Alvarez-Melis
SlidesLive Video |
馃敆 |
Fri 1:00 a.m. - 1:15 a.m.
|
Oral Presentation 1: Parameter-Efficient Quantized MoE Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis
SlidesLive Video |
馃敆 |
Fri 2:15 a.m. - 2:45 a.m.
|
Invited Talk 3: Boran Han
SlidesLive Video |
馃敆 |
Fri 2:45 a.m. - 3:00 a.m.
|
Oral Presentation 2: RouteFinder: Towards Foundation Models for Vehicle Routing Problems
SlidesLive Video |
馃敆 |
Fri 3:00 a.m. - 3:30 a.m.
|
Invited Talk 4: Hannah Kerner
SlidesLive Video |
馃敆 |
Fri 4:30 a.m. - 4:45 a.m.
|
UK AI Safety Institute: Empirically Assessing AI's Risks & Advancing Systemic Safety
SlidesLive Video |
馃敆 |
Fri 4:45 a.m. - 5:00 a.m.
|
Oral Presentation 3: DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning
SlidesLive Video |
馃敆 |
Fri 5:00 a.m. - 5:30 a.m.
|
Invited Talk 5: Steven Wu
SlidesLive Video |
馃敆 |
Fri 6:30 a.m. - 7:00 a.m.
|
Invited Talk 6: Pang Wei Koh
SlidesLive Video |
馃敆 |
Fri 7:00 a.m. - 7:30 a.m.
|
Invited Talk 7: Jimeng Sun
|
馃敆 |
Fri 7:30 a.m. - 8:00 a.m.
|
Invited Talk 8: Sheng Wang
SlidesLive Video |
馃敆 |
-
|
Vision-Language Models Provide Promptable Representations for Reinforcement Learning ( Poster ) > link | William Chen 路 Oier Mees 路 Aviral Kumar 路 Sergey Levine 馃敆 |
-
|
When Do Language Models Need to Be Large? ( Poster ) > link | Zhixun Chen 路 Yali Du 路 David Mguni 馃敆 |
-
|
Inference Performance Optimization for Large Language Models on CPUs ( Poster ) > link | Pujiang He 路 Shan Zhou 路 Wenhuan Huang 路 Changqing Li 路 Duyi Wang 路 Bin Guo 路 Chen Meng 路 Sheng Gui 路 Weifei Yu 路 Yi Xie 馃敆 |
-
|
Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data ( Poster ) > link |
14 presentersMatthias Gerstgrasser 路 Rylan Schaeffer 路 Apratim Dey 路 Rafael Rafailov 路 Tomasz Korbak 路 Henry Sleight 路 Rajashree Agrawal 路 John Hughes 路 Dhruv Pai 路 Andrey Gromov 路 Dan Roberts 路 Diyi Yang 路 David Donoho 路 Sanmi Koyejo |
-
|
PLUTO: Pathology-Universal Transformer ( Poster ) > link |
33 presentersDinkar Juyal 路 Harshith Padigela 路 Chintan Shah 路 Daniel Shenker 路 Natalia Harguindeguy 路 Yi Liu 路 Blake Martin 路 Yibo Zhang 路 Michael Nercessian 路 Miles Markey 路 Isaac Finberg 路 Kelsey Luu 路 Daniel Borders 路 Syed Ashar Javed 路 Emma Krause 路 Raymond Biju 路 Aashish Sood 路 Allen Ma 路 Jackson Nyman 路 John Shamshoian 路 Guillaume Chhor 路 Darpan Sanghavi 路 Marc Thibault 路 Limin Yu 路 Fedaa Najdawi 路 Jennifer Hipp 路 Darren Fahy 路 Benjamin Glass 路 Eric Walk 路 John Abel 路 Harsha pokkalla 路 Andrew Beck 路 Sean Grullon |
-
|
Unsupervised Feature Extraction from a Foundation Model Zoo for Cell Similarity Search in Oncological Microscopy Across Devices ( Poster ) > link |
15 presentersGabriel Kalweit 路 Anusha Klett 路 Mehdi Naouar 路 Jens Rahnfeld 路 Yannick Vogt 路 Diana Ramirez 路 Rebecca Berger 路 Jesus Afonso 路 Tanja Hartmann 路 Marie Follo 路 Michael Luebbert 路 Roland Mertelsmann 路 Evelyn Ullrich 路 Joschka Boedecker 路 Maria Kalweit |
-
|
The Effect of Data Corruption on Multimodal Long Form Responses ( Poster ) > link | Daniel Kaplan 路 Alexis Roger 路 Mohamed Osman 路 Irina Rish 馃敆 |
-
|
Pretrained Hybrids with MAD Skills ( Poster ) > link | Nicholas Roberts 路 Samuel Guo 路 Zhiqi Gao 路 Satya Sai Srinath Namburi GNVV 路 Sonia Cromp 路 Chengjun Wu 路 Chengyu Duan 路 Frederic Sala 馃敆 |
-
|
Model Breadcrumbs: Scalable Upcycling of Finetuned Foundation Models via Sparse Task Vectors Merging ( Poster ) > link | MohammadReza Davari 路 Eugene Belilovsky 馃敆 |
-
|
Strong Copyright Protection for Language Models via Adaptive Model Fusion ( Poster ) > link | Javier Abad 路 Konstantin Donhauser 路 Francesco Pinto 路 Fanny Yang 馃敆 |
-
|
FoMu-SSL: Foundation Model-Guided Multi-Sensor Self-Supervised Learning for Remote Sensing ( Poster ) > link | Da Bin Seo 路 Haeji Jung 路 Jinkyu Kim 馃敆 |
-
|
A Critical Look At Tokenwise Reward-Guided Text Generation ( Poster ) > link | Ahmad Rashid 路 Ruotian Wu 路 Julia Grosse 路 Agustinus Kristiadi 路 Pascal Poupart 馃敆 |
-
|
GROD: Enhancing Generalization of Transformer with Out-of-Distribution Detection ( Poster ) > link | Yijin Zhou 路 Yu Guang Wang 馃敆 |
-
|
It Takes Two: On the Seamlessness between Reward and Policy Model in RLHF ( Poster ) > link | TaiMing Lu 路 Lingfeng Shen 路 Xinyu Yang 路 Weiting Tan 路 Beidi Chen 路 Huaxiu Yao 馃敆 |
-
|
Open LLMs are Necessary for Private Adaptations and Outperform their Closed Alternatives ( Poster ) > link | Vincent Hanke 路 Tom Blanchard 路 Franziska Boenisch 路 Iyiola Emmanuel Olatunji 路 Michael Backes 路 Adam Dziedzic 馃敆 |
-
|
Waterfall: Framework for Robust and Scalable Text Watermarking ( Poster ) > link | Gregory Kang Ruey Lau 路 Xinyuan Niu 路 Hieu Dao 路 Jiangwei Chen 路 Chuan-Sheng Foo 路 Bryan Kian Hsiang Low 馃敆 |
-
|
OTTER: Effortless Label Distribution Adaptation of Zero-shot Models ( Poster ) > link | Changho Shin 路 Jitian Zhao 路 Sonia Cromp 路 Harit Vishwakarma 路 Frederic Sala 馃敆 |
-
|
Towards Safe Large Language Models for Medicine ( Poster ) > link | Tessa Han 路 Aounon Kumar 路 Chirag Agarwal 路 Himabindu Lakkaraju 馃敆 |
-
|
POST: A Framework for Privacy of Soft-prompt Transfer ( Poster ) > link | Xun Wang 路 Jing Xu 路 Franziska Boenisch 路 Michael Backes 路 Adam Dziedzic 馃敆 |
-
|
Two-Level Test-Time Adaptation in Multimodal Learning ( Poster ) > link | Jixiang Lei 路 Franz Pernkopf 馃敆 |
-
|
Jogging the Memory of Unlearned Models Through Targeted Relearning Attacks ( Poster ) > link | Shengyuan Hu 路 Yiwei Fu 路 Steven Wu 路 Virginia Smith 馃敆 |
-
|
End-To-End Causal Effect Estimation from Unstructured Natural Language Data ( Poster ) > link | Nikita Dhawan 路 Leonardo Cotta 路 Karen Ullrich 路 Rahul G. Krishnan 路 Chris Maddison 馃敆 |
-
|
On the Privacy Risks of Post-Hoc Explanations of Foundation Models ( Poster ) > link | Catherine Huang 路 Martin Pawelczyk 路 Himabindu Lakkaraju 馃敆 |
-
|
An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Foundation Models ( Poster ) > link | Scott C. Lowe 路 Joakim Haurum 路 Sageev Oore 路 Thomas Moeslund 路 Graham Taylor 馃敆 |
-
|
Estimating Probability Densities of Tabular Data using a Transformer Model combined with Denoising Diffusion ( Poster ) > link | Henry Leung 路 Jo Bovy 路 Joshua Speagle 馃敆 |
-
|
RouteFinder: Towards Foundation Models for Vehicle Routing Problems ( Oral ) > link | Federico Berto 路 Chuanbo HUA 路 Nayeli Gast Zepeda 路 Andr茅 Hottung 路 Niels Wouda 路 Leon Lan 路 Kevin Tierney 路 Jinkyoo Park 馃敆 |
-
|
TriLM vs FloatLM: Ternary LLMs are more Performant than Quantized FP16 LLMs ( Poster ) > link | Ayush Kaushal 路 Tejas Vaidhya 路 Tejas Pandey 路 Aaryan Bhagat 路 Irina Rish 馃敆 |
-
|
Adaptive Concept Bottleneck for Foundation Models ( Poster ) > link | Jihye Choi 路 Jayaram Raghuram 路 Sharon Li 路 Suman Banerjee 路 Somesh Jha 馃敆 |
-
|
Recursive Introspection: Teaching LLM Agents How to Self-Improve ( Poster ) > link | Yuxiao Qu 路 Tianjun Zhang 路 Naman Garg 路 Aviral Kumar 馃敆 |
-
|
Domain-Aware Fine-Tuning of Foundation Models ( Poster ) > link | Ugur Kaplan 路 Yumeng Li 路 Margret Keuper 路 Anna Khoreva 路 Dan Zhang 馃敆 |
-
|
Adversarially Robust CLIP Models Induce Better (Robust) Perceptual Metrics ( Poster ) > link | Francesco Croce 路 Christian Schlarmann 路 Naman Singh 路 Matthias Hein 馃敆 |
-
|
Self-Control of LLM Behaviors by Compressing Suffix Gradient into Prefix Controller ( Poster ) > link | Min Cai 路 Yuchen Zhang 路 Shichang Zhang 路 Fan Yin 路 Difan Zou 路 Yisong Yue 路 ziniu hu 馃敆 |
-
|
Instruction Tuning With Loss Over Instructions ( Poster ) > link | zhengxiang shi 路 Adam Yang 路 Bin Wu 路 Laurence Aitchison 路 Emine Yilmaz 路 Aldo Lipani 馃敆 |
-
|
LoRD: Low-Rank Decomposition of Monolingual Code LLMs for One-Shot Compression ( Poster ) > link | Ayush Kaushal 路 Tejas Vaidhya 路 Irina Rish 馃敆 |
-
|
On the Discrepancy and Connection between Memorization and Generation in Diffusion Models ( Poster ) > link | Hanyu Wang 路 Yujin Han 路 Difan Zou 馃敆 |
-
|
Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs ( Poster ) > link | Jiatong Han 路 Jannik Kossen 路 Muhammed Razzak 路 Lisa Schut 路 Shreshth Malik 路 Yarin Gal 馃敆 |
-
|
Test-Time Prototype Evolution for Generalizable Vision-Language Models ( Poster ) > link | Ce Zhang 路 Simon Stepputtis 路 Katia Sycara 路 Yaqi Xie 馃敆 |
-
|
Bilingual Adaptation of Monolingual Foundation Models ( Poster ) > link |
21 presentersGurpreet Gosal 路 Yishi Xu 路 Gokulakrishnan Ramakrishnan 路 Rituraj Joshi 路 Avraham Sheinin 路 Zhiming Chen 路 Biswajit Mishra 路 Sunil Sahu 路 Neha Sengupta 路 Natalia Vassilieva 路 Joel Hestness 路 Samujjwal Ghosh 路 Bokang Jia 路 Onkar Pandit 路 Satheesh Katipomu 路 Samta Kamboj 路 Rahul Pal 路 Parvez Mullah 路 Soundar Doraiswamy 路 Karim Chami 路 Preslav Nakov |
-
|
-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphs ( Poster ) > link | Vlad Sobal 路 Mark Ibrahim 路 Randall Balestriero 路 Vivien Cabannnes 路 Diane Bouchacourt 路 Pietro Astolfi 路 Kyunghyun Cho 路 Yann LeCun 馃敆 |
-
|
CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models ( Poster ) > link |
24 presentersPeng Xia 路 Ze Chen 路 Juanxi Tian 路 Gong Yangrui 路 Ruibo Hou 路 Yue Xu 路 Zhenbang Wu 路 Zhiyuan Fan 路 Yiyang Zhou 路 Kangyu Zhu 路 Wenhao Zheng 路 Zhaoyang Wang 路 Xiao Wang 路 Xuchao Zhang 路 Chetan Bansal 路 Marc Niethammer 路 Junzhou Huang 路 Hongtu Zhu 路 Yun Li 路 Jimeng Sun 路 Zongyuan Ge 路 Gang Li 路 James Zou 路 Huaxiu Yao |
-
|
SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound ( Poster ) > link | Rishit Dagli 路 Shivesh Prakash 路 Robert Wu 路 Houman Khosravani 馃敆 |
-
|
LLM Task Interference: Impact of Task-Switch in Conversational History ( Poster ) > link | Akash Gupta 路 Ivaxi Sheth 路 Vyas Raina 路 Mark Gales 路 Mario Fritz 馃敆 |
-
|
Projected Language Models: A Large Model Pre-Segmented Into Smaller Ones ( Poster ) > link | David Grangier 路 Angelos Katharopoulos 路 Pierre Ablin 路 Awni Hannun 馃敆 |
-
|
Private Fine-tuning of Large Language Models with Zeroth-order Optimization ( Poster ) > link | Xinyu Tang 路 Ashwinee Panda 路 Milad Nasr 路 Saeed Mahloujifar 路 Prateek Mittal 馃敆 |
-
|
BUILD: Buffer-free Incremental Learning with OOD Detection for the Wild ( Poster ) > link | Srishti Gupta 路 Daniele Angioni 路 Lea Sch枚nherr 路 Ambra Demontis 路 Battista Biggio 馃敆 |
-
|
Improving GFlowNets for Text-to-Image Diffusion Alignment ( Poster ) > link | Dinghuai Zhang 路 Yizhe Zhang 路 Jiatao Gu 路 Ruixiang ZHANG 路 Joshua M Susskind 路 Navdeep Jaitly 路 Shuangfei Zhai 馃敆 |
-
|
Zero-Shot Generalization of GNNs over Distinct Attribute Domains ( Poster ) > link | Yangyi Shen 路 Beatrice Bevilacqua 路 Joshua Robinson 路 Charilaos Kanatsoulis 路 Jure Leskovec 路 Bruno Ribeiro 馃敆 |
-
|
Improving Graph-Language Alignment with Hierarchical Graph Tokenization ( Poster ) > link | Yongqiang Chen 路 QUANMING YAO 路 Juzheng Zhang 路 James Cheng 路 Yatao Bian 馃敆 |
-
|
Federated Fine-Tuning of Vision Foundation Models via Probabilistic Masking ( Poster ) > link | Vasileios Tsouvalas 路 Yuki Asano 路 Aaqib Saeed 馃敆 |
-
|
Benchmarking Robust Self-Supervised Learning Across Diverse Downstream Tasks ( Poster ) > link | Antoni Kowalczuk 路 Jan Dubi艅ski 路 Atiyeh Ashari 路 yi sui 路 George Stein 路 Jiapeng Wu 路 Jesse Cresswell 路 Franziska Boenisch 路 Adam Dziedzic 馃敆 |
-
|
Black-Box Detection of Language Model Watermarks ( Poster ) > link | Thibaud Gloaguen 路 Nikola Jovanovi膰 路 Robin Staab 路 Martin Vechev 馃敆 |
-
|
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts ( Poster ) > link | Samar Khanna 路 Medhanie Irgau 路 David Lobell 路 Stefano Ermon 馃敆 |
-
|
AdaptiveBackdoor: Backdoored Language Model Agents that Detect Human Overseers ( Poster ) > link | Heng Wang 路 Ruiqi Zhong 路 Jiaxin Wen 路 Jacob Steinhardt 馃敆 |
-
|
Language Model-In-The-Loop: Data Optimal Approach to Recommend Actions in Text Games ( Poster ) > link | Arjun V SS 路 Prasanna Parthasarathi 路 Janarthanan Rajendran 路 Sarath Chandar 馃敆 |
-
|
Understanding the Role of Functional Diversity in Weight-Ensembling with Ingredient Selection and Multidimensional Scaling ( Poster ) > link | Alex Rojas 路 David Alvarez-Melis 馃敆 |
-
|
ContextCite: Attributing Model Generation to Context ( Poster ) > link | Benjamin Cohen-Wang 路 Harshay Shah 路 Kristian Georgiev 路 Aleksander Madry 馃敆 |
-
|
DistilDIRE: A Small, Fast, Cheap and Lightweight Diffusion Synthesized Deepfake Detection ( Poster ) > link | Yewon Lim 路 Changyeon Lee 路 Ah Young Kim 路 Oren Etzioni 馃敆 |
-
|
An Auditing Test to Detect Behavioral Shift in Language Models ( Poster ) > link | Leo Richter 路 Nitin Agrawal 路 Xuanli He 路 Pasquale Minervini 路 Matt Kusner 馃敆 |
-
|
Quantum 3D Visual Grounding: A Step Towards Quantum-inspired AI-Visualization ( Poster ) > link | Adib Bazgir 路 Rama Madugula 路 Yuwen Zhang 馃敆 |
-
|
Adapting LLM Agents with Universal Feedback in Communication ( Poster ) > link | Kuan Wang 路 Yadong Lu 路 Michael Santacroce 路 Yeyun Gong 路 Chao Zhang 路 Yelong Shen 馃敆 |
-
|
Code Agents are State of The Art Software Testers ( Poster ) > link | Niels M眉ndler 路 Mark M眉ller 路 Jingxuan He 路 Martin Vechev 馃敆 |
-
|
Out-Of-Context Prompting Boosts Fairness and Robustness in Large Language Model Predictions ( Poster ) > link | Leonardo Cotta 路 Chris Maddison 馃敆 |
-
|
Evaluation of RAG Metrics for Question Answering in the Telecom Domain ( Poster ) > link | Sujoy Roychowdhury 路 Sumit Soman 路 Ranjani H G 路 Neeraj Gunda 路 Vansh Chhabra 路 Sai Krishna Bala 馃敆 |
-
|
Extracting Training Data from Document-Based VQA Models ( Poster ) > link | Francesco Pinto 路 Nathalie Rauschmayr 路 Florian Tramer 路 Phil Torr 路 Federico Tombari 馃敆 |
-
|
Privacy Auditing of Large Language Models ( Poster ) > link | Ashwinee Panda 路 Xinyu Tang 路 Milad Nasr 路 Christopher A. Choquette Choo 路 Prateek Mittal 馃敆 |
-
|
USCILab3D: A Large-scale, Long-term, Semantically Annotated Outdoor Dataset ( Poster ) > link | Kiran Lekkala 路 Henghui Bao 路 Peixu Cai 路 Wei Lim 路 Chen Liu 路 Laurent Itti 馃敆 |
-
|
Merging Improves Self-Critique Against Jailbreak Attacks ( Poster ) > link | Victor Gallego 馃敆 |
-
|
CharED: Character-wise Ensemble Decoding for Large Language Models ( Poster ) > link | Kevin Gu 路 Eva Tuecke 路 Dmitriy Katz 路 Raya Horesh 路 David Alvarez-Melis 路 Mikhail Yurochkin 馃敆 |
-
|
MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge? ( Poster ) > link |
19 presentersZhaorun Chen 路 Yichao Du 路 Zichen Wen 路 Yiyang Zhou 路 Chenhang Cui 路 Zhenzhen Weng 路 Haoqin Tu 路 Chaoqi Wang 路 Zhengwei Tong 路 Leria HUANG 路 Canyu Chen 路 Qinghao Ye 路 Zhihong Zhu 路 Yuqing Zhang 路 Jiawei Zhou 路 Zhuokai Zhao 路 Rafael Rafailov 路 Chelsea Finn 路 Huaxiu Yao |
-
|
Extrapolative Protein Design through Triplet-based Preference Learning ( Poster ) > link | Mostafa Karimi 路 Sharmi Banerjee 路 Tommi Jaakkola 路 Bella Dubrov 路 Shang Shang 路 Ron Benson 馃敆 |
-
|
LIFTED: Multimodal Mixture-of-Experts for Clinical Trial Outcome Prediction ( Poster ) > link | Wenhao Zheng 路 Dongshen Peng 路 Hongxia Xu 路 Yun Li 路 Hongtu Zhu 路 Tianfan Fu 路 Huaxiu Yao 馃敆 |
-
|
RNR: Teaching Large Language Models to Follow Roles and Rules ( Poster ) > link |
12 presentersKuan Wang 路 Alexander Bukharin 路 Haoming Jiang 路 Qingyu Yin 路 Zhengyang Wang 路 Tuo Zhao 路 Jingbo Shang 路 Chao Zhang 路 Bing Yin 路 Xian Li 路 Jianshu Chen 路 Shiyang Li |
-
|
Unveiling CLIP Dynamics: Linear Mode Connectivity and Generalization ( Poster ) > link | Alireza Abdollahpourrostam 路 Amartya Sanyal 路 Seyed-Mohsen Moosavi-Dezfooli 馃敆 |
-
|
TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model ( Poster ) > link | Defu Cao 路 Wen Ye 路 Yan Liu 馃敆 |
-
|
Rapid Switching and Multi-Adapter Fusion via Sparse High Rank Adapters ( Poster ) > link |
12 presentersKartikeya Bhardwaj 路 Nilesh Prasad Pandey 路 Sweta Priyadarshi 路 Viswanath Ganapathy 路 Rafael Esteves 路 Shreya Kadambi 路 Shubhankar Borse 路 Paul Whatmough 路 Risheek Garrepalli 路 Marinus van Baalen 路 Harris Teague 路 Markus Nagel |
-
|
Split, Unlearn, Merge: Leveraging Data Attributes for More Effective Unlearning in LLMs ( Poster ) > link | Swanand Kadhe 路 Farhan Ahmed 路 Dennis Wei 路 Nathalie Baracaldo 路 Inkit Padhi 馃敆 |
-
|
Efficient Evolutionary Search over Chemical Space with Large Language Models ( Poster ) > link |
14 presentersHaorui Wang 路 Marta Skreta 路 Yuanqi Du 路 Wenhao Gao 路 Lingkai Kong 路 Cher-Tian Ser 路 Felix Strieth-Kalthoff 路 Chenru Duan 路 Yuchen Zhuang 路 Yue Yu 路 Yanqiao Zhu 路 Alan Aspuru-Guzik 路 Kirill Neklyudov 路 Chao Zhang |
-
|
Evaluating Self-Supervised Foundation Models in Holographic Imaging ( Poster ) > link | Silas Dietler 路 Yanick Zeder 路 Elias Graf 路 Kilian Koch 路 Andreas Schwendimann 路 Tommaso Bendinelli 馃敆 |
-
|
In Search of Forgotten Domain Generalization ( Poster ) > link | Prasanna Mayilvahanan 路 Roland S. Zimmermann 路 Thadd盲us Wiedemer 路 Evgenia Rusak 路 Attila Juhos 路 Matthias Bethge 路 Wieland Brendel 馃敆 |
-
|
Calibrated Self-Rewarding Vision Language Models ( Poster ) > link | Yiyang Zhou 路 Zhiyuan Fan 路 Dongjie Cheng 路 Sihan Yang 路 Zhaorun Chen 路 Chenhang Cui 路 xiyao wang 路 Yun Li 路 Linjun Zhang 路 Huaxiu Yao 馃敆 |
-
|
MoRe Fine-Tuning with 10x Fewer Parameters ( Poster ) > link | Wenxuan Tan 路 Nicholas Roberts 路 Tzu-Heng Huang 路 Jitian Zhao 路 John Cooper 路 Samuel Guo 路 Chengyu Duan 路 Frederic Sala 馃敆 |
-
|
Leveraging Generative Foundation Models for Domain Generalization ( Poster ) > link | Sobhan Hemati 路 Mahdi Beitollahi 路 Amir Estiri 路 Bassel Al Omari 路 Xi Chen 路 Guojun Zhang 馃敆 |
-
|
Dual Risk Minimization for Robust Fine-tuning of Zero-Shot Models ( Poster ) > link | Kaican Li 路 Weiyan XIE 路 Ricardo Silva 路 Nevin Zhang 馃敆 |
-
|
In-Context Learning Improves Compositional Understanding of Vision-Language Models ( Poster ) > link | Matteo Nulli 路 Anesa Ibrahimi 路 Avik Pal 路 Hoshe Lee 路 Ivona Najdenkoska 馃敆 |
-
|
Combining Pre-trained LoRA Modules Improves Few-shot Adaptation of Foundation Models to New Tasks ( Poster ) > link | Nader Asadi 路 Mahdi Beitollahi 路 Yasser Khalil 路 Yinchuan Li 路 Guojun Zhang 路 Xi Chen 馃敆 |
-
|
Not Just Pretty Pictures: Toward Interventional Data Augmentation Using Text-to-Image Generators ( Poster ) > link | Jianhao Yuan 路 Francesco Pinto 路 Adam Davies 路 Phil Torr 馃敆 |
-
|
DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning ( Oral ) > link | Hao Bai 路 Yifei Zhou 路 Mert Cemri 路 Jiayi Pan 路 Alane Suhr 路 Sergey Levine 路 Aviral Kumar 馃敆 |
-
|
InstructBooth: Instruction-following Personalized Text-to-Image Generation ( Poster ) > link | Daewon Chae 路 Nokyung Park 路 Jinkyu Kim 路 Kimin Lee 馃敆 |
-
|
Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models ( Poster ) > link | Lukas Struppek 路 Dominik Hintersdorf 路 Kristian Kersting 路 Adam Dziedzic 路 Franziska Boenisch 馃敆 |
-
|
PanSAM: Zero-Shot, Prompt-Free Pancreas Segmentation in CT Imaging ( Poster ) > link | Abolfazl Malekahmadi 路 Mohammad T. Teimuri Jervakani 路 Armin Behnamnia 路 Zahra Dehghanian 路 Amir Shamloo 路 Hamid R Rabiee 馃敆 |
-
|
Geometric Median Matching for Robust Data Pruning ( Poster ) > link | Anish Acharya 路 Inderjit Dhillon 路 Sujay Sanghavi 馃敆 |
-
|
Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data? ( Poster ) > link | Jonathan Hayase 路 Alisa Liu 路 Yejin Choi 路 Sewoong Oh 路 Noah Smith 馃敆 |
-
|
Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis ( Oral ) > link | Sagar Srinivas Sakhinana 路 Sannidhi Geethan 路 Chidaksh Ravuru 路 Venkataramana Runkana 馃敆 |
-
|
Generalization vs. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data ( Poster ) > link | Antonis Antoniades 路 Xinyi Wang 路 Yanai Elazar 路 Alfonso Amayuelas 路 Alon Albalak 路 Kexun Zhang 路 William Wang 馃敆 |
-
|
VFA: Vision Frequency Analysis of Foundation Models and Human ( Poster ) > link | Javad Bayazi 路 Md Rifat Arefin 路 Jocelyn Faubert 路 Irina Rish 馃敆 |