As machine learning models are introduced into every aspect of our lives, and potential benefits become abundant, so do possible catastrophic failures. One of the most common failure scenarios when deploying machine learning models in the wild, which could possibly lead to dire consequences in extreme cases, is the reliance of models on apparently unnatural or irrelevant features.
The issue comes up in a variety of applications: from the reliance of detection models for X-rays on scanner types and marks made by technicians in the hospital, through visual question answering models being sensitive to linguistic variations in the questions, the list of examples for such undesirable behaviors keeps growing.In examples like these, the undesirable behavior stems from the model exploiting a spurious correlation.
Following last year's workshop on Spurious Correlations, Invariance and Stability (SCIS), it is apparent that work on spurious correlations is a long-term effort that spans communities such as fairness, causality-inspired ML, and domains such as NLP, healthcare and many others. Hence we hope that this year's workshop, the second edition of SCIS, will help facilitate this long term effort across communities. The workshop will feature talks by top experts doing methodological work on dealing with spurious correlations, and an extended poster session to allow extensive discussion on work submitted to the workshop.
Opening Remarks | |
Distribution Shifts in Generalist and Causal Models (Talk) | |
Paper Spotlights (Spotlight) | |
Break | |
On learning domain general predictors (Talk) | |
Using Causality to Improve Safety Throughout the AI Lifecycle (Talk) | |
Lunch Break (Break) | |
A data-centric view on reliable generalization: From ImageNet to LAION-5B (Talk) | |
Causal vs Causality-inspired representation learning (Talk) | |
Poster Session 1 (in-person only) (Poster Session) | |
SCIS 2023 Panel, The Future of Generalization: Scale, Safety and Beyond (Panel Discussion) | |
Causal Conversation + Poster Session 2 (Poster Session) | |
Bias-to-Text: Debiasing Unknown Visual Biases by Language Interpretation (Poster) | |
Complementing a Policy with a Different Observation Space (Poster) | |
Implications of Gaussian process kernel mismatch for out-of-distribution data (Poster) | |
Confident feature ranking (Poster) | |
Towards Understanding Feature Learning in Out-of-Distribution Generalization (Poster) | |
Spuriosity Didn’t Kill the Classifier: Using Invariant Predictions to Harness Spurious Features (Poster) | |
Approximate Causal Effect Identification under Weak Confounding (Poster) | |
Causal Dynamics Learning with Quantized Local Independence Discovery (Poster) | |
Shortcut Detection with Variational Autoencoders (Poster) | |
Concept Algebra for Score-based Conditional Model (Poster) | |
(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy (Poster) | |
Antibody DomainBed: Towards robust predictions using invariant representations of biological sequences carrying complex distribution shifts (Oral) | |
Towards A Scalable Solution for Compositional Multi-Group Fair Classification (Poster) | |
Learning Independent Causal Mechanisms (Poster) | |
Identifiability Guarantees for Causal Disentanglement from Soft Interventions (Poster) | |
Why is SAM Robust to Label Noise? (Poster) | |
Uncertainty-Guided Online Test-Time Adaptation via Meta-Learning (Poster) | |
Saving a Split for Last-layer Retraining can Improve Group Robustness without Group Annotations (Poster) | |
Removing Multiple Biases through the Lens of Multi-task Learning (Poster) | |
Replicable Reinforcement Learning (Poster) | |
Separating multimodal modeling from multidimensional modeling for multimodal learning (Poster) | |
Exploring new ways: Enforcing representational dissimilarity to learn new features and reduce error consistency (Poster) | |
Stabilizing GNN for Fairness via Lipschitz Bounds (Poster) | |
Calibrated Propensities for Causal Effect Estimation (Poster) | |
Leveraging sparse and shared feature activations for disentangled representation learning (Poster) | |
Do as your neighbors: Invariant learning through non-parametric neighbourhood matching (Poster) | |
Learning Diverse Features in Vision Transformers for Improved Generalization (Poster) | |
Front-door Adjustment Beyond Markov Equivalence with Limited Graph Knowledge (Poster) | |
Arbitrary Decisions are a Hidden Cost of Differentially Private Training (Poster) | |
Out of the Ordinary: Spectrally Adapting Regression for Covariate Shift (Poster) | |
Provable domain adaptation using privileged information (Oral) | |
A Cosine Similarity-based Method for Out-of-Distribution Detection (Poster) | |
Towards Modular Learning of Deep Causal Generative Models (Poster) | |
Deep Neural Networks Extrapolate Cautiously (Most of the Time) (Poster) | |
Spuriosity Rankings for Free: A Simple Framework for Last Layer Retraining Based on Object Detection (Poster) | |
Contextual Vision Transformers for Robust Representation Learning (Poster) | |
Results on Counterfactual Invariance (Poster) | |
Group Robustness via Adaptive Class-Specific Scaling (Poster) | |
Causal-structure Driven Augmentations for Text OOD Generalization (Poster) | |
Leveraging Task Structures for Improved Identifiability in Neural Network Representations (Poster) | |
Adversarial Data Augmentations for Out-of-Distribution Generalization (Poster) | |
Feature Selection in the Presence of Monotone Batch Effects (Poster) | |
Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Models (Poster) | |
Robust Learning with Progressive Data Expansion Against Spurious Correlation (Poster) | |
Weighted Risk Invariance for Density-Aware Domain Generalization (Poster) | |
SAFE: Stable Feature Extraction without Environment Labels (Poster) | |
Large Dimensional Change Point Detection with FWER Control as Automatic Stopping (Poster) | |
Where Does My Model Underperform?: A Human Evaluation of Slice Discovery Algorithms (Oral) | |
Regularizing Model Gradients with Concepts to Improve Robustness to Spurious Correlations (Poster) | |
Complementary Benefits of Contrastive Learning and Self-Training Under Distribution Shift (Poster) | |
Seeing is not Believing: Robust Reinforcement Learning against Spurious Correlation (Poster) | |
Optimization or Architecture: What Matters in Non-Linear Filtering? (Poster) | |
Improve Identity-Robustness for Face Models (Poster) | |
Reviving Shift Equivariance in Vision Transformers (Poster) | |
Breaking the Spurious Causality of Conditional Generation via Fairness Intervention with Corrective Sampling (Poster) | |
Look Beneath the Surface: Exploiting Fundamental Symmetry for Sample-Efficient Offline Reinforcement Learning (Poster) | |
Data Models for Dataset Drift Controls in Machine Learning With Optical Images (Poster) | |
Understanding the Detrimental Class-level Effects of Data Augmentation (Poster) | |
Transportable Representations for Out-of-distribution Generalization (Poster) | |
Towards Fair Knowledge Distillation using Student Feedback (Poster) | |
Last-Layer Fairness Fine-tuning is Simple and Effective for Neural Networks (Poster) | |
Which Features are Learned by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression (Poster) | |
Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning (Poster) | |
Shortcut Learning Through the Lens of Training Dynamics (Poster) | |
Pruning for Better Domain Generalizability (Poster) | |
Regularizing Adversarial Imitation Learning Using Causal Invariance (Poster) | |
ERM++: An Improved Baseline for Domain Generalization (Poster) | |
Neuro-Causal Factor Analysis (Poster) | |
Learning Linear Causal Representations from Interventions under General Nonlinear Mixing (Poster) | |
ModelDiff: A Framework for Comparing Learning Algorithms (Oral) | |
Identifiability of Discretized Latent Coordinate Systems via Density Landmarks Detection (Poster) | |
C-Disentanglement: Discovering Causally-Independent Generative Factors under an Inductive Bias of Confounder (Poster) | |
Studying Generalization on Memory-Based Methods in Continual Learning (Poster) | |
Fairness-Preserving Regularizer: Balancing Core and Spurious Features (Poster) | |
Temporal Consistency based Test Time Adaptation: Towards Fair and Personalized AI (Poster) | |
Identifying and Disentangling Spurious Features in Pretrained Image Representations (Poster) | |
Prediction without Preclusion: Recourse Verification with Reachable Sets (Poster) | |
Impact of Noise on Calibration and Generalisation of Neural Networks (Poster) | |
Bridging the Domain Gap by Clustering-based Image-Text Graph Matching (Poster) | |
Learning Counterfactually Invariant Predictors (Poster) | |
The Role of Linguistic Priors in Measuring Compositional Generalization of Vision-language Models (Poster) | |
Sharpness-Aware Minimization Enhances Feature Diversity (Poster) | |
Group Fairness with Uncertainty in Sensitive Attributes (Poster) | |
Cross-Risk Minimization: Inferring Groups Information for Improved Generalization (Poster) | |
Robustness through Loss Consistency Regularization (Poster) | |
Mitigating Simplicity Bias in Deep Learning for Improved OOD Generalization and Robustness (Poster) | |
Spurious Correlations and Where to Find Them (Poster) | |
Invariant Causal Set Covering Machines (Poster) | |
Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confounding (Oral) | |
Tackling Shortcut Learning in Deep Neural Networks: An Iterative Approach with Interpretable Models (Poster) | |