Timezone: »
Unsupervised domain adaptation is critical to many real-world applications where label information is unavailable in the target domain. In general, without further assumptions, the joint distribution of the features and the label is not identifiable in the target domain. To address this issue, we rely on a property of minimal changes of causal mechanisms across domains to minimize unnecessary influences of domain shift. To encode this property, we first formulate the data generating process using a latent variable model with two partitioned latent subspaces: invariant components whose distributions stay the same across domains, and sparse changing components that vary across domains. We further constrain the domain shift to have a restrictive influence on the changing components. Under mild conditions, we show that the latent variables are partially identifiable, from which it follows that the joint distribution of data and labels in the target domain is also identifiable. Given the theoretical insights, we propose a practical domain adaptation framework, called iMSDA. Extensive experimental results reveal that iMSDA outperforms state-of-the-art domain adaptation algorithms on benchmark datasets, demonstrating the effectiveness of our framework.
Author Information
Lingjing Kong (Carnegie Mellon University)
Shaoan Xie (Carnegie Mellon University)
Weiran Yao (Carnegie Mellon University)
Yujia Zheng (Carnegie Mellon University)
Guangyi Chen (MBZUAI)
Petar Stojanov (Broad Institute of MIT and Harvard)
Victor Akinwande (Carnegie Mellon University)
Kun Zhang (Carnegie Mellon University)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: Partial disentanglement for domain adaptation »
Tue. Jul 19th through Wed the 20th Room Hall E #538
More from the Same Authors
-
2021 : Optimal transport for causal discovery »
Ruibo Tu · Kun Zhang · Hedvig Kjellström · Cheng Zhang -
2022 : Causal Balancing for Domain Generalization »
Xinyi Wang · Michael Saxon · Jiachen Li · Hongyang Zhang · Kun Zhang · William Wang -
2023 : Counterfactual Generation with Identifiability Guarantees »
Hanqi Yan · Lingjing Kong · Lin Gui · Yuejie Chi · Eric Xing · Yulan He · Kun Zhang -
2023 : Identification of Nonlinear Latent Hierarchical Causal Models »
Lingjing Kong · Biwei Huang · Feng Xie · Eric Xing · Yuejie Chi · Kun Zhang -
2023 : Advancing Counterfactual Inference through Quantile Regression »
Shaoan Xie · Biwei Huang · Bin Gu · Tongliang Liu · Kun Zhang -
2023 : Natural Counterfactuals With Necessary Backtracking »
Guangyuan Hao · Jiji Zhang · Hao Wang · Kun Zhang -
2023 : Understanding prompt engineering does not require rethinking generalization »
Victor Akinwande · Yiding Jiang · Dylan Sam · Zico Kolter -
2023 : Natural Counterfactuals With Necessary Backtracking »
Guangyuan Hao · Jiji Zhang · Hao Wang · Kun Zhang -
2023 Poster: Identifiability of Label Noise Transition Matrix »
Yang Liu · Hao Cheng · Kun Zhang -
2023 Poster: Causal Discovery with Latent Confounders Based on Higher-Order Cumulants »
Ruichu Cai · Zhiyi Huang · Wei Chen · Zhifeng Hao · Kun Zhang -
2023 Poster: Feature Expansion for Graph Neural Networks »
Jiaqi Sun · Lin Zhang · Guangyi Chen · Peng XU · Kun Zhang · Yujiu Yang -
2023 Poster: Model Transferability with Responsive Decision Subjects »
Yatong Chen · Zeyu Tang · Kun Zhang · Yang Liu -
2023 Poster: Evolving Semantic Prototype Improves Generative Zero-Shot Learning »
Shiming Chen · Wenjin Hou · Ziming Hong · Xiaohan Ding · Yibing Song · Xinge You · Tongliang Liu · Kun Zhang -
2023 Poster: Which is Better for Learning with Noisy Labels: The Semi-supervised Method or Modeling Label Noise? »
Yu Yao · Mingming Gong · Yuxuan Du · Jun Yu · Bo Han · Kun Zhang · Tongliang Liu -
2022 : Paper 23: Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving »
Jonathan Francis · Weiran Yao · Bingqing Chen -
2022 : Model Transferability With Responsive Decision Subjects »
Yang Liu · Yatong Chen · Zeyu Tang · Kun Zhang -
2022 Poster: Identification of Linear Non-Gaussian Latent Hierarchical Structure »
Feng Xie · Biwei Huang · Zhengming Chen · Yangbo He · zhi geng · Kun Zhang -
2022 Poster: Action-Sufficient State Representation Learning for Control with Structural Constraints »
Biwei Huang · Chaochao Lu · Liu Leqi · Jose Miguel Hernandez-Lobato · Clark Glymour · Bernhard Schölkopf · Kun Zhang -
2022 Spotlight: Action-Sufficient State Representation Learning for Control with Structural Constraints »
Biwei Huang · Chaochao Lu · Liu Leqi · Jose Miguel Hernandez-Lobato · Clark Glymour · Bernhard Schölkopf · Kun Zhang -
2022 Spotlight: Identification of Linear Non-Gaussian Latent Hierarchical Structure »
Feng Xie · Biwei Huang · Zhengming Chen · Yangbo He · zhi geng · Kun Zhang -
2020 Poster: Label-Noise Robust Domain Adaptation »
Xiyu Yu · Tongliang Liu · Mingming Gong · Kun Zhang · Kayhan Batmanghelich · Dacheng Tao -
2020 Poster: LTF: A Label Transformation Framework for Correcting Label Shift »
Jiaxian Guo · Mingming Gong · Tongliang Liu · Kun Zhang · Dacheng Tao -
2020 Poster: Characterizing Distribution Equivalence and Structure Learning for Cyclic and Acyclic Directed Graphs »
AmirEmad Ghassami · Alan Yang · Negar Kiyavash · Kun Zhang -
2019 Poster: Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models »
Biwei Huang · Kun Zhang · Mingming Gong · Clark Glymour -
2019 Oral: Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models »
Biwei Huang · Kun Zhang · Mingming Gong · Clark Glymour -
2019 Poster: On Learning Invariant Representations for Domain Adaptation »
Han Zhao · Remi Tachet des Combes · Kun Zhang · Geoff Gordon -
2019 Oral: On Learning Invariant Representations for Domain Adaptation »
Han Zhao · Remi Tachet des Combes · Kun Zhang · Geoff Gordon