Timezone: »

 
Poster
Imitation Learning from Imperfect Demonstration
Yueh-Hua Wu · Nontawat Charoenphakdee · Han Bao · Voot Tangkaratt · Masashi Sugiyama

Tue Jun 11 06:30 PM -- 09:00 PM (PDT) @ Pacific Ballroom #47
in Posters Tue »

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel approach that utilizes confidence scores, which describe the quality of demonstrations. More specifically, we propose two confidence-based IL methods, namely two-step importance weighting IL (2IWIL) and generative adversarial IL with imperfect demonstration and confidence (IC-GAIL). We show that confidence scores given only to a small portion of sub-optimal demonstrations significantly improve the performance of IL both theoretically and empirically.

Keywords: Deep Reinforcement Learning · Semi-supervised learning

Author Information

Yueh-Hua Wu (National Taiwan University / RIKEN)
Nontawat Charoenphakdee (The University of Tokyo / RIKEN)
Han Bao (The University of Tokyo / RIKEN)
Voot Tangkaratt (RIKEN AIP)
Masashi Sugiyama (RIKEN / The University of Tokyo)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors