Timezone: »
Unsupervised skill discovery is one of the approaches by which the agent learns potentially useful and distinct behaviors without any explicit reward. The agent is then expected to quickly solve downstream tasks by properly using a set of discovered skills rather than learning everything from scratch.However, it is non-trivial to optimally utilize the discovered skills for each task, which can be viewed as a fine-tuning method, and this has been less considered in the literature in spite of its importance. In this paper, we compare some fine-tuning methods showing how they inefficiently utilize the discovered skills and also propose new methods, which are sample-efficient and effective by interpreting the skills as a perspective of how an agent transforms the input state. Our code is available at https://anonymous.4open.science/r/unsupervisedRL-87F3
Author Information
Eunseok Yang (Seoul National University)
JUNGSUB RHIM (Seoul National University)
Taesup Kim (Seoul National University)
More from the Same Authors
-
2022 : Adaptive Interest for Emphatic Reinforcement Learning »
Martin Klissarov · Rasool Fakoor · Jonas Mueller · Kavosh Asadi · Taesup Kim · Alex Smola -
2023 : Uncertainty-Guided Online Test-Time Adaptation via Meta-Learning »
kyubyung chae · Taesup Kim -
2023 : UOTA: Unsupervised Open-Set Task Adaptation Using a Vision-Language Foundation Model »
Youngjo Min · Kwangrok Ryoo · Bumsoo Kim · Taesup Kim -
2023 Poster: Flexible Model Aggregation for Quantile Regression »
Rasool Fakoor · Taesup Kim · Jonas Mueller · Alexander Smola · Ryan Tibshirani