Timezone: »

 
Representation Learning as Finding Necessary and Sufficient Causes
Yixin Wang · Michael Jordan

@
in Spurious correlations, Invariance, and Stability (SCIS) »
Event URL: https://openreview.net/forum?id=_rqQZ_HL_fY »

Representation learning constructs low-dimensional representations tosummarize essential features of high-dimensional data. This learningproblem is often approached by describing various desiderataassociated with learned representations; e.g., that they benon-spurious or efficient. It can be challenging, however, to turnthese intuitive desiderata into formal criteria that can be measuredand enhanced based on observed data. In this paper, we take a causalperspective on representation learning, formalizing non-spuriousnessand efficiency (in supervised representation learning) usingcounterfactual quantities and observable consequences of causalassertions. This yields computable metrics that can be used to assessthe degree to which representations satisfy the desiderata of interestand learn non-spurious representations from single observationaldatasets.

Keywords: Representation Learning · Causal Inference · disentanglement · probabilities of causation · non-spuriousness

Author Information

Yixin Wang (Columbia University)
Michael Jordan (UC Berkeley)

More from the Same Authors