Skip to yearly menu bar Skip to main content


Talk

Learning to Aggregate Ordinal Labels by Maximizing Separating Width

Guangyong Chen · Shengyu Zhang · Di Lin · Hui Huang · Pheng Ann Heng

C4.9& C4.10

Abstract:

While crowdsourcing has been a cost and time efficient method to label massive samples, one critical issue is quality control, for which the key challenge is to infer the ground truth from noisy or even adversarial data by various users. A large class of crowdsourcing problems, such as those involving age, grade, level, or stage, have an ordinal structure in their labels. Based on a technique of sampling estimated label from the posterior distribution, we define a novel separating width among the labeled observations to characterize the quality of sampled labels, and develop an efficient algorithm to optimize it through solving multiple linear decision boundaries and adjusting prior distributions. Our algorithm is empirically evaluated on several real world datasets, and demonstrates its supremacy over state-of-the-art methods.

Live content is unavailable. Log in and register to view live content