Timezone: »
Estimating heterogeneous treatment effects from observational data is a central problem in many domains. Because counterfactual data is inaccessible, the problem differs fundamentally from supervised learning, and entails a more complex set of modeling choices. Despite a variety of recently proposed algorithmic solutions, a principled guideline for building estimators of treatment effects using machine learning algorithms is still lacking. In this paper, we provide such a guideline by characterizing the fundamental limits of estimating heterogeneous treatment effects, and establishing conditions under which these limits can be achieved. Our analysis reveals that the relative importance of the different aspects of observational data vary with the sample size. For instance, we show that selection bias matters only in small-sample regimes, whereas with a large sample size, the way an algorithm models the control and treated outcomes is what bottlenecks its performance. Guided by our analysis, we build a practical algorithm for estimating treatment effects using a non-stationary Gaussian processes with doubly-robust hyperparameters. Using a standard semi-synthetic simulation setup, we show that our algorithm outperforms the state-of-the-art, and that the behavior of existing algorithms conforms with our analysis.
Author Information
Ahmed M. Alaa (UCLA)
Mihaela van der Schaar (UCLA)

Professor van der Schaar is John Humphrey Plummer Professor of Machine Learning, Artificial Intelligence and Medicine at the University of Cambridge, a Turing Faculty Fellow at The Alan Turing Institute in London, and Chancellor's Professor at UCLA. She was elected IEEE Fellow in 2009. She has received numerous awards, including the Oon Prize on Preventative Medicine from the University of Cambridge (2018), an NSF Career Award (2004), 3 IBM Faculty Awards, the IBM Exploratory Stream Analytics Innovation Award, the Philips Make a Difference Award and several best paper awards, including the IEEE Darlington Award. She holds 35 granted USA patents. In 2019, she was identified by National Endowment for Science, Technology and the Arts as the female researcher based in the UK with the most publications in the field of AI. She was also elected as a 2019 "Star in Computer Networking and Communications". Her current research focus is on machine learning, AI and operations research for healthcare and medicine. For more details, see her website: http://www.vanderschaar-lab.com/
Related Events (a corresponding poster, oral, or spotlight)
-
2018 Oral: Limits of Estimating Heterogeneous Treatment Effects: Guidelines for Practical Algorithm Design »
Wed. Jul 11th 11:30 -- 11:50 AM Room K1 + K2
More from the Same Authors
-
2022 Poster: Data-SUITE: Data-centric identification of in-distribution incongruous examples »
Nabeel Seedat · Jonathan CrabbĂ© · Mihaela van der Schaar -
2022 Poster: Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential Equations »
Nabeel Seedat · Fergus Imrie · Alexis Bellot · Zhaozhi Qian · Mihaela van der Schaar -
2022 Spotlight: Data-SUITE: Data-centric identification of in-distribution incongruous examples »
Nabeel Seedat · Jonathan CrabbĂ© · Mihaela van der Schaar -
2022 Spotlight: Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential Equations »
Nabeel Seedat · Fergus Imrie · Alexis Bellot · Zhaozhi Qian · Mihaela van der Schaar -
2022 Poster: How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Models »
Ahmed Alaa · Boris van Breugel · Evgeny S. Saveliev · Mihaela van der Schaar -
2022 Spotlight: How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Models »
Ahmed Alaa · Boris van Breugel · Evgeny S. Saveliev · Mihaela van der Schaar -
2021 : Mihaela Van der Schaar: Time-series in healthcare: challenges and solutions »
Mihaela van der Schaar -
2021 : Quantitative epistemology: conceiving a new human-machine partnership »
Mihaela van der Schaar -
2021 Poster: Learning Queueing Policies for Organ Transplantation Allocation using Interpretable Counterfactual Survival Analysis »
Jeroen Berrevoets · Ahmed Alaa · Zhaozhi Qian · James Jordon · alexander gimson · Mihaela van der Schaar -
2021 Spotlight: Learning Queueing Policies for Organ Transplantation Allocation using Interpretable Counterfactual Survival Analysis »
Jeroen Berrevoets · Ahmed Alaa · Zhaozhi Qian · James Jordon · alexander gimson · Mihaela van der Schaar -
2021 Tutorial: Synthetic Healthcare Data Generation and Assessment: Challenges, Methods, and Impact on Machine Learning »
Ahmed M. Alaa · Mihaela van der Schaar -
2021 : Synthetic Healthcare Data Generation and Assessment: Challenges, Methods, and Impact on Machine Learning »
Ahmed M. Alaa · Mihaela van der Schaar -
2020 : Panel Discussion »
Neil Lawrence · Mihaela van der Schaar · Alex Smola · Valerio Perrone · Jack Parker-Holder · Zhengying Liu -
2020 : "Automated ML and its transformative impact on medicine and healthcare" by Mihaela van der Schaar »
Mihaela van der Schaar -
2020 : Invited Talk: Learning despite the unknown - missing data imputation in healthcare »
Mihaela van der Schaar -
2020 Poster: Unlabelled Data Improves Bayesian Uncertainty Calibration under Covariate Shift »
Alexander Chan · Ahmed Alaa · Zhaozhi Qian · Mihaela van der Schaar -
2020 Poster: Discriminative Jackknife: Quantifying Uncertainty in Deep Learning via Higher-Order Influence Functions »
Ahmed Alaa · Mihaela van der Schaar -
2020 Poster: Time Series Deconfounder: Estimating Treatment Effects over Time in the Presence of Hidden Confounders »
Ioana Bica · Ahmed Alaa · Mihaela van der Schaar -
2020 Poster: Frequentist Uncertainty in Recurrent Neural Networks via Blockwise Influence Functions »
Ahmed Alaa · Mihaela van der Schaar -
2019 Poster: Validating Causal Inference Models via Influence Functions »
Ahmed Alaa · Mihaela van der Schaar -
2019 Oral: Validating Causal Inference Models via Influence Functions »
Ahmed Alaa · Mihaela van der Schaar -
2018 Poster: AutoPrognosis: Automated Clinical Prognostic Modeling via Bayesian Optimization with Structured Kernel Learning »
Ahmed M. Alaa · Mihaela van der Schaar -
2018 Oral: AutoPrognosis: Automated Clinical Prognostic Modeling via Bayesian Optimization with Structured Kernel Learning »
Ahmed M. Alaa · Mihaela van der Schaar -
2017 Poster: Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosis »
Ahmed M. Alaa · Scott B Hu · Mihaela van der Schaar -
2017 Talk: Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosis »
Ahmed M. Alaa · Scott B Hu · Mihaela van der Schaar