Timezone: »

Self-Imitation Learning
Junhyuk Oh · Yijie Guo · Satinder Singh · Honglak Lee

Fri Jul 13 09:15 AM -- 12:00 PM (PDT) @ Hall B #60

This paper proposes Self-Imitation Learning (SIL), a simple off-policy actor-critic algorithm that learns to reproduce the agent's past good decisions. This algorithm is designed to verify our hypothesis that exploiting past good experiences can indirectly drive deep exploration. Our empirical results show that SIL significantly improves advantage actor-critic (A2C) on several hard exploration Atari games and is competitive to the state-of-the-art count-based exploration methods. We also show that SIL improves proximal policy optimization (PPO) on MuJoCo tasks.

Author Information

Junhyuk Oh (University of Michigan)
Yijie Guo (University of Michigan)
Satinder Singh (University of Michigan)
Honglak Lee (Google / U. Michigan)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors