Timezone: »

 
Oral
Bidirectional Adaptation for Robust Semi-Supervised Learning with Inconsistent Data Distributions
Lin-Han Jia · Lan-Zhe Guo · Zhi Zhou · Jie-Jing Shao · Yuke Xiang · Yu-Feng Li

Wed Jul 26 07:32 PM -- 07:40 PM (PDT) @ Ballroom B
in Oral B5 Self/Semi-Supervised Learning and Interpretability / Observing Aspects of NN »

Semi-supervised learning (SSL) suffers from severe performance degradation when labeled and unlabeled data come from inconsistent data distributions. However, there is still a lack of sufficient theoretical guidance on how to alleviate this problem. In this paper, we propose a general theoretical framework that demonstrates how distribution discrepancies caused by pseudo-label predictions and target predictions can lead to severe generalization errors. Through theoretical analysis, we identify three main reasons why previous SSL algorithms cannot perform well with inconsistent distributions: coupling between the pseudo-label predictor and the target predictor, biased pseudo labels, and restricted sample weights. To address these challenges, we introduce a practical framework called Bidirectional Adaptation that can adapt to the distribution of unlabeled data for debiased pseudo-label prediction and to the target distribution for debiased target prediction, thereby mitigating these shortcomings. Extensive experimental results demonstrate the effectiveness of our proposed framework.

[ Slides]  [ PDF] 

Author Information

Lin-Han Jia (NanJing University)
Lan-Zhe Guo (Nanjing University)
Zhi Zhou (Nanjing University)
Jie-Jing Shao (Nanjing University)
Yuke Xiang (Huawei Technologies Ltd.)
Yu-Feng Li (Nanjing University)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors