Timezone: »

 
Spotlight
Estimating Instance-dependent Label-noise Transition Matrix using a Deep Neural Network
Shuo Yang · Erkun Yang · Bo Han · Yang Liu · Min Xu · Gang Niu · Tongliang Liu

Thu Jul 21 07:30 AM -- 07:35 AM (PDT) @ None

In label-noise learning, estimating the transition matrix is a hot topic as the matrix plays an important role in building statistically consistent classifiers. Traditionally, the transition from clean labels to noisy labels (i.e., clean label transition matrix) has been widely exploited to learn a clean label classifier by employing the noisy data. Motivated by that classifiers mostly output Bayes optimal labels for prediction, in this paper, we study to directly model the transition from Bayes optimal labels to noisy labels (i.e., Bayes label transition matrix) and learn a classifier to predict Bayes optimal labels. Note that given only noisy data, it is ill-posed to estimate either the clean label transition matrix or the Bayes label transition matrix. But favorably, Bayes optimal labels have less uncertainty compared with the clean labels, i.e., the class posteriors of Bayes optimal labels are one-hot vectors while those of clean labels are not. This enables two advantages to estimate the Bayes label transition matrix, i.e., (a) a set of examples with theoretically guaranteed Bayes optimal labels can be collected out of noisy data; (b) the feasible solution space is much smaller. By exploiting the advantages, we estimate the Bayes label transition matrix by employing a deep neural network in a parameterized way, leading to better generalization and superior classification performance.

Author Information

Shuo Yang (University of Technology Sydney)
Erkun Yang (Xidian University)
Bo Han (HKBU / RIKEN)
Yang Liu (UC Santa Cruz)
Min Xu (Univeristy of Technology Sydney)
Gang Niu (RIKEN)
Gang Niu

Gang Niu is currently an indefinite-term research scientist at RIKEN Center for Advanced Intelligence Project.

Tongliang Liu (The University of Sydney)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors