Skip to yearly menu bar Skip to main content


Workshop

Data-centric Machine Learning Research (DMLR): Datasets for Foundation Models

Adam Mahdi ⋅ Ludwig Schmidt ⋅ Alexandros Dimakis ⋅ Rotem Dror ⋅ Georgia Gkioxari ⋅ Sang Truong ⋅ Lilith Bat-Leah ⋅ Fatimah Alzamzami ⋅ Georgios Smyrnis ⋅ Thao Nguyen ⋅ Nezihe Merve Gürel ⋅ Paolo Climaco ⋅ Luis Oala ⋅ Hailey Schoelkopf ⋅ Andrew M. Bean ⋅ Berivan Isik ⋅ Vaishaal Shankar ⋅ Mayee Chen ⋅ Achal Dave
Project Page

Abstract

Video

Chat is not available.

Schedule

Timezone: Asia/Seoul
4:00 PM
Opening Remarks
4:15 PM
Invited Talk 1: Aditi Raghunathan
Aditi Raghunathan
5:00 PM
Invited Talk 2: Stella Biderman
Stella Biderman
5:45 PM
Break
6:00 PM
Panel
7:30 PM
Lunch Break
9:00 PM
Invited Talk 3: Lucas Beyer
Lucas Beyer
9:45 PM
Paper Talks
11:00 PM
Poster Session
Natural Language to Class-level Code Generation by Iterative Tool-augmented Reasoning over Repository
Ajinkya Deshpande ⋅ Anmol Agarwal ⋅ Shashank Shet ⋅ Arun Iyer ⋅ Aditya Kanade ⋅ Ramakrishna Bairi ⋅ Suresh Iyengar
Dataset distillation for offline reinforcement learning
Jonathan Light ⋅ Yuanzhe Liu ⋅ ziniu hu
Understanding Bias in Visual Datasets
Boya Zeng ⋅ Yida Yin ⋅ Zhuang Liu
Weak-to-Strong Generalization Through the Data-Centric Lens
Changho Shin ⋅ John Cooper ⋅ Dyah Adila ⋅ Frederic Sala
DeepRod: A human-in-the-loop system for automatic rodent behavior analysis
Adrian Christoph Loy ⋅ Miha Garafolj ⋅ Heike Schauerte ⋅ Hanna Behnke ⋅ Cyrille Charnier ⋅ Philipp Schwarz ⋅ Kathrin Eschmann ⋅ Georg Rast ⋅ Thomas Wollmann
Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data
Matthias Gerstgrasser ⋅ Rylan Schaeffer ⋅ Apratim Dey ⋅ Rafael Rafailov ⋅ Tomasz Korbak ⋅ Henry Sleight ⋅ Rajashree Agrawal ⋅ John Hughes ⋅ Dhruv Pai ⋅ Andrey Gromov ⋅ Dan Roberts ⋅ Diyi Yang ⋅ David Donoho ⋅ Sanmi Koyejo
Brevity is the soul of wit: Pruning long files for code generation
Aaditya Singh ⋅ Yu Yang ⋅ Kushal Tirumala ⋅ Mostafa Elhoushi ⋅ Ari Morcos
A data-centric approach for assessing progress of Graph Neural Networks
Tianqi Zhao ⋅ Thi Ngan Dong ⋅ Alan Hanjalic ⋅ Megha Khosla
Major TOM: Expandable Datasets for Earth Observation
Mikolaj Czerkawski ⋅ Alistair Francis
Collaboratively Learning Robust Models from Noisy Decentralized Data
Haoyuan Li ⋅ Mathias Funk ⋅ Nezihe Merve Gürel ⋅ Aaqib Saeed
The Tug-of-War Between Deepfake Generation and Detection
Hannah Lee ⋅ Changyeon Lee ⋅ Kevin Farhat ⋅ Lin Qiu ⋅ Steve Geluso ⋅ Ah Young Kim ⋅ Oren Etzioni
Datasets for Time Series Foundation Models
Arjun Choudhry ⋅ Konrad Szafer ⋅ Mononito Goswami ⋅ Yifu Cai ⋅ Artur Dubrawski
A Comparative Analysis of Influence Signals for Data Debugging
Nikolaos Myrtakis ⋅ Ioannis Tsamardinos ⋅ VASSILIS CHRISTOPHIDES
AraTrust: An Evaluation of Trustworthiness for LLMs in Arabic
Emad Alghamdi ⋅ Reem Masoud ⋅ Deema Alnuhait ⋅ Afnan Alomairi ⋅ Ahmed Ashraf ⋅ Mohamed Zaytoon
Large-Scale Dataset Pruning in Adversarial Training through Data Importance Extrapolation
Björn Nieth ⋅ Thomas Altstidl ⋅ Leo Schwinn ⋅ Bjoern Eskofier
Spurious Correlations in Machine Learning: A Survey
Wenqian Ye ⋅ Guangtao Zheng ⋅ Xu Cao ⋅ Yunsheng Ma ⋅ Aidong Zhang
Resource Efficient Datasets for Inferring Parameters of Differential Equations
Antanas Murelis ⋅ Mojmir Mutny ⋅ Lenart Treven ⋅ Ugne Sakenyte ⋅ Andreas Krause
Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?
Rylan Schaeffer ⋅ Hailey Schoelkopf ⋅ Brando Miranda ⋅ Gabriel Mukobi ⋅ Varun Madan ⋅ Adam Ibrahim ⋅ Herbie Bradley ⋅ Stella Biderman ⋅ Sanmi Koyejo
Evaluating $n$-Gram Novelty of Language Models
William Merrill ⋅ Noah Smith ⋅ Yanai Elazar
Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark
Elizabeth M Fons Etcheverry ⋅ Rachneet Kaur ⋅ Soham Palande ⋅ Zhen Zeng ⋅ Svitlana Vyetrenko ⋅ Tucker Balch
BioinformaticsBench: A collaboratively built large language model benchmark for Bioinformatics reasoning
Varuni Sarwal ⋅ Seungmo Lee ⋅ Rosemary He ⋅ Aingela Kattapuram ⋅ Xiaoxuan Wang ⋅ Yijia Xiao ⋅ Serghei Mangul ⋅ Wei Wang
Evaluating Music Understanding in Multimodal Audio-Language Models
Benno Weck ⋅ Ilaria Manco ⋅ Emmanouil Benetos ⋅ Elio Quinton ⋅ George Fazekas ⋅ Dmitry Bogdanov
Understanding Hallucinations in Diffusion Models through Mode Interpolation
Sumukh K Aithal ⋅ Pratyush Maini ⋅ Zachary Lipton ⋅ Zico Kolter
Many Perception Tasks are Highly Redundant Functions of their Input Data
Rahul Ramesh ⋅ Anthony Bisulco ⋅ Ronald Di Tullio ⋅ Linran Wei ⋅ Vijay Balasubramanian ⋅ Kostas Daniilidis ⋅ Pratik Chaudhari
Truthful Dataset Valuation by Pointwise Mutual Information
SHURAN ZHENG ⋅ Yongchan Kwon ⋅ Xuan Qi ⋅ James Zou
On Evaluation of Vision Datasets and Models using Human Competency Frameworks
Rahul Ramachandran ⋅ Tejal Kulkarni ⋅ Charchit Sharma ⋅ Deepak Vijaykeerthy ⋅ Vineeth N Balasubramanian
AdaEmbed: Semi-supervised Domain Adaptation in the Embedding Space
Ali Mottaghi ⋅ Muhammad Abdullah Jamal ⋅ Serena Yeung ⋅ Omid Mohareri
VideoPhy: Evaluating Physical Commonsense In Video Generation
Hritik Bansal ⋅ Zongyu Lin ⋅ Tianyi Xie ⋅ Zeshun Zong ⋅ Chenfanfu Jiang ⋅ Yizhou Sun ⋅ Kai-Wei Chang ⋅ Aditya Grover
Multilingual Diversity Improves Vision-Language Representations
Thao Nguyen ⋅ Matthew Wallingford ⋅ Sebastin Santy ⋅ Wei-Chiu Ma ⋅ Sewoong Oh ⋅ Ludwig Schmidt ⋅ Pang Wei Koh ⋅ Ranjay Krishna
Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts
Jacob Haimes ⋅ Cenny Wenner ⋅ Kunvar Thaman ⋅ Vassil Tashev ⋅ Clement Neo ⋅ Esben Kran ⋅ Jason Schreiber, né Hoelscher-Obermaier
Robust 6DoF Pose Estimation Against Depth Noise and a Comprehensive Evaluation on a Mobile Dataset
Zixun Huang ⋅ Keling Yao ⋅ Seth Zhao ⋅ Chuanyu Pan ⋅ Chenfeng Xu ⋅ Kathy Zhuangs ⋅ Tianjian Xu ⋅ Weiyu Feng ⋅ Allen Yang
Data Generation using Large Language Models for Text Classification: An Empirical Case Study
Yinheng Li ⋅ Rogerio Bonatti ⋅ Sara Abdali ⋅ Justin Wagle ⋅ Kazuhito Koishida
Bayesian Data Selection
Julian Rodemann
Towards Bridging Classical and Neural Computation through a Read-Eval-Print Loop
David Zhang ⋅ Michaël Defferrard ⋅ Corrado Rainone ⋅ Roland Memisevic
In Search of Forgotten Domain Generalization
Prasanna Mayilvahanan ⋅ Roland S. Zimmermann ⋅ Thaddäus Wiedemer ⋅ Evgenia Rusak ⋅ Attila Juhos ⋅ Matthias Bethge ⋅ Wieland Brendel
Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization
Hritik Bansal ⋅ Ashima Suvarna ⋅ Gantavya Bhatt ⋅ Nanyun Peng ⋅ Kai-Wei Chang ⋅ Aditya Grover
The CLRS-Text Algorithmic Reasoning Benchmark
Larisa Markeeva ⋅ Sean McLeish ⋅ Borja Ibarz ⋅ Wilfried Bounsi ⋅ Olga Kozlova ⋅ Alex Vitvitskyi ⋅ Charles Blundell ⋅ Tom Goldstein ⋅ Avi Schwarzschild ⋅ Petar Veličković
Data Mixture Inference Attack: BPE Tokenizers Reveal Training Data Compositions
Jonathan Hayase ⋅ Alisa Liu ⋅ Yejin Choi ⋅ Sewoong Oh ⋅ Noah Smith
Quantifying Spuriousness of Biased Datasets Using Partial Information Decomposition
Barproda Halder ⋅ Faisal Hamman ⋅ Sachindra P Dissanayake ⋅ Richard Zhang ⋅ Ilia Sucholutsky ⋅ Sanghamitra Dutta
Data Shapley in One Training Run
Jiachen Wang ⋅ Prateek Mittal ⋅ Dawn Song ⋅ Ruoxi Jia
What is the Right Notion of Distance between Predict-then-Optimize Tasks?
Paula Rodriguez-Diaz ⋅ Kai Wang ⋅ David Alvarez-Melis ⋅ Milind Tambe
Helpful or Harmful Data? Fine-tuning-free Shapley Attribution for Explaining Language Model Predictions
Jingtan Wang ⋅ Xiaoqiang Lin ⋅ Rui Qiao ⋅ Chuan-Sheng Foo ⋅ Bryan Kian Hsiang Low
Compute-efficient LLM Training via Online Batch Selection
Jiachen Wang ⋅ Tong Wu ⋅ Dawn Song ⋅ Prateek Mittal ⋅ Ruoxi Jia
Does your data spark joy? Performance gains from domain upsampling at the end of training
Cody Blakeney ⋅ Mansheej Paul ⋅ Brett Larsen ⋅ Sean Owen ⋅ Jonathan Frankle
Is Aligned Data the Optimal Training Data?
Elyas Obbad ⋅ Brando Miranda
No Filter: Cultural and Socioeconomic Diversity in Contrastive Vision–Language Models
Angéline Pouget ⋅ Lucas Beyer ⋅ Emanuele Bugliarello ⋅ Xiao Wang ⋅ Andreas Steiner ⋅ Xiaohua Zhai ⋅ Ibrahim Alabdulmohsin
CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning
Yiping Wang ⋅ Yifang Chen ⋅ Wendan Yan ⋅ Alex Fang ⋅ Wenjing Zhou ⋅ Kevin Jamieson ⋅ Simon Du
The Neglected Tails in Vision-Language Models
Shubham Parashar ⋅ Zhiqiu Lin ⋅ Tian Liu ⋅ Xiangjue Dong ⋅ Yanan Li ⋅ Deva Ramanan ⋅ James Caverlee ⋅ Shu Kong
Efficient and Accurate Explanation Estimation with Distribution Compression
Hubert Baniecki ⋅ Giuseppe Casalicchio ⋅ Bernd Bischl ⋅ Przemyslaw Biecek
Stronger Than You Think: Benchmarking Weak Supervision on Realistic Tasks
Tianyi Zhang ⋅ Linrong Cai ⋅ Nicholas Roberts ⋅ Jeffrey Li ⋅ Neel Guha ⋅ Frederic Sala
COBRA: COmBinatorial Retrieval Augmentation for Few-Shot Learning
Arnav M Das ⋅ Gantavya Bhatt ⋅ Lilly Kumari ⋅ Sahil Verma ⋅ Jeff Bilmes
Training-free Design of Augmentations with Data-centric Principles
Jieke Wu ⋅ Wei Huang ⋅ Mingyuan Bai ⋅ Xiaoling Hu ⋅ Yi Duan ⋅ Wuyang Chen
Learning to Reason by Failing: Offline RL on Sub-optimal Rollouts Scales Synthetic Data by 8x
Amrith Setlur ⋅ Saurabh Garg ⋅ Xinyang Geng ⋅ Naman Garg ⋅ Virginia Smith ⋅ Aviral Kumar
Efficient Ensembles Improve Training Data Attribution
Junwei Deng ⋅ Ting-Wei Li ⋅ Shichang Zhang ⋅ Jiaqi Ma
Understanding the Gains from Repeated Self-Distillation
Divyansh Pareek ⋅ Simon Du ⋅ Sewoong Oh
Open Artificial Knowledge
Vadim Borisov ⋅ Richard Schreiber
CONTEXTUAL: Evaluating Context-Sensitive Text-Rich Visual Reasoning in Large Multimodal Models
Rohan Wadhawan ⋅ Hritik Bansal ⋅ Kai-Wei Chang ⋅ Nanyun Peng
Community search signatures as foundation features for human-centered geospatial modeling
Mimi Sun ⋅ Chaitanya Kamath ⋅ MOHIT AGARWAL ⋅ Arbaaz Muslim ⋅ Yangli Yee ⋅ David Schottlander ⋅ Shailesh Bavadekar ⋅ Niv Efron ⋅ SHRAVYA SHETTY ⋅ Gautam Prasad
Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach
Van Huy Vo ⋅ Vasil Khalidov ⋅ Timothée Darcet ⋅ Théo Moutakanni ⋅ Nikita Smetanin ⋅ Marc Szafraniec ⋅ Hugo Touvron ⋅ Camille Couprie ⋅ Maxime Oquab ⋅ Armand Joulin ⋅ Herve Jegou ⋅ Patrick Labatut ⋅ Piotr Bojanowski
PabLO: Improving Semi-Supervised Learning with Pseudolabeling Optimization
Harit Vishwakarma ⋅ Yi Chen ⋅ Satya Sai Srinath Namburi GNVV ⋅ Sui Jiet Tay ⋅ Ramya Vinayak ⋅ Frederic Sala
Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist
Zihao Zhou ⋅ Shudong Liu ⋅ Maizhen Ning ⋅ Wei Liu ⋅ Derek Wong ⋅ Jindong Wang ⋅ Qiufeng Wang ⋅ Kaizhu Huang
Pearls from Pebbles: Improved Confidence Functions for Auto-labeling
Harit Vishwakarma ⋅ Yi Chen ⋅ Sui Jiet Tay ⋅ Satya Sai Srinath Namburi GNVV ⋅ Frederic Sala ⋅ Ramya Vinayak
What Data-Centric AI Can Do For k-means: a Faster, Robust kmeans-d
PARICHIT SHARMA ⋅ HASAN KURBAN ⋅ Mehmet Dalkilic