Timezone: »

Efficient Task Adaptation by Mixing Discovered Skills
Eunseok Yang · JUNGSUB RHIM · Taesup Kim
Event URL: https://openreview.net/forum?id=zkG3N8uff3V »

Unsupervised skill discovery is one of the approaches by which the agent learns potentially useful and distinct behaviors without any explicit reward. The agent is then expected to quickly solve downstream tasks by properly using a set of discovered skills rather than learning everything from scratch.However, it is non-trivial to optimally utilize the discovered skills for each task, which can be viewed as a fine-tuning method, and this has been less considered in the literature in spite of its importance. In this paper, we compare some fine-tuning methods showing how they inefficiently utilize the discovered skills and also propose new methods, which are sample-efficient and effective by interpreting the skills as a perspective of how an agent transforms the input state. Our code is available at https://anonymous.4open.science/r/unsupervisedRL-87F3

Author Information

Eunseok Yang (Seoul National University)
JUNGSUB RHIM (Seoul National University)
Taesup Kim (Seoul National University)

More from the Same Authors