Timezone: »
Poster
ODS: Test-Time Adaptation in the Presence of Open-World Data Shift
Zhi Zhou · Lan-Zhe Guo · Lin-Han Jia · Dingchu Zhang · Yu-Feng Li
Test-time adaptation (TTA) adapts a source model to the distribution shift in testing data without using any source data. There have been plenty of algorithms concentrated on covariate shift in the last decade, i.e., $\mathcal{D}_t(X)$, the distribution of the test data is different from the source data. Nonetheless, in real application scenarios, it is necessary to consider the influence of label distribution shift, i.e., both $\mathcal{D}_t(X)$ and $\mathcal{D}_t(Y)$ are shifted, which has not been sufficiently explored yet. To remedy this, we study a new problem setup, namely, TTA with Open-world Data Shift (AODS). The goal of AODS is simultaneously adapting a model to covariate and label distribution shifts in the test phase. In this paper, we first analyze the relationship between classification error and distribution shifts. Motivated by this, we hence propose a new framework, namely ODS, which decouples the mixed distribution shift and then addresses covariate and label distribution shifts accordingly. We conduct experiments on multiple benchmarks with different types of shifts, and the results demonstrate the superior performance of our method against the state of the arts. Moreover, ODS is suitable for many TTA algorithms.
Author Information
Zhi Zhou (Nanjing University)
Lan-Zhe Guo (Nanjing University)
Lin-Han Jia (NanJing University)
Dingchu Zhang (Nanjing University)
Yu-Feng Li (Nanjing University)
Related Events (a corresponding poster, oral, or spotlight)
-
2023 Oral: ODS: Test-Time Adaptation in the Presence of Open-World Data Shift »
Thu. Jul 27th 03:04 -- 03:12 AM Room Ballroom A
More from the Same Authors
-
2023 Oral: Bidirectional Adaptation for Robust Semi-Supervised Learning with Inconsistent Data Distributions »
Lin-Han Jia · Lan-Zhe Guo · Zhi Zhou · Jie-Jing Shao · Yuke Xiang · Yu-Feng Li -
2023 Poster: Bidirectional Adaptation for Robust Semi-Supervised Learning with Inconsistent Data Distributions »
Lin-Han Jia · Lan-Zhe Guo · Zhi Zhou · Jie-Jing Shao · Yuke Xiang · Yu-Feng Li -
2023 Poster: Identifying Useful Learnwares for Heterogeneous Label Spaces »
Lan-Zhe Guo · Zhi Zhou · Yu-Feng Li · Zhi-Hua Zhou -
2022 Poster: Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding »
Lan-Zhe Guo · Yu-Feng Li -
2022 Spotlight: Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding »
Lan-Zhe Guo · Yu-Feng Li -
2021 Poster: Dash: Semi-Supervised Learning with Dynamic Thresholding »
Yi Xu · Lei Shang · Jinxing Ye · Qi Qian · Yu-Feng Li · Baigui Sun · Hao Li · rong jin -
2021 Oral: Dash: Semi-Supervised Learning with Dynamic Thresholding »
Yi Xu · Lei Shang · Jinxing Ye · Qi Qian · Yu-Feng Li · Baigui Sun · Hao Li · rong jin -
2020 Poster: Safe Deep Semi-Supervised Learning for Unseen-Class Unlabeled Data »
Lan-Zhe Guo · Zhen-Yu Zhang · Yuan Jiang · Yu-Feng Li · Zhi-Hua Zhou