Timezone: »

 
Spotlight
Individual Reward Assisted Multi-Agent Reinforcement Learning
Li Wang · Yupeng Zhang · Yujing Hu · Weixun Wang · Chongjie Zhang · Yang Gao · Jianye Hao · Tangjie Lv · Changjie Fan

Tue Jul 19 02:10 PM -- 02:15 PM (PDT) @ Room 318 - 320
in RL: Multi-agent »

In many real-world multi-agent systems, the sparsity of team rewards often makes it difficult for an algorithm to successfully learn a cooperative team policy. At present, the common way for solving this problem is to design some dense individual rewards for the agents to guide the cooperation. However, most existing works utilize individual rewards in ways that do not always promote teamwork and sometimes are even counterproductive. In this paper, we propose \emph{Individual Reward Assisted Team Policy Learning} (IRAT), which learns two policies for each agent from the dense individual reward and the sparse team reward with discrepancy constraints for updating the two policies mutually. Experimental results in different scenarios, such as the Multi-Agent Particle Environment and the Google Research Football Environment, show that IRAT significantly outperforms the baseline methods and can greatly promote team policy learning without deviating from the original team objective, even when the individual rewards are misleading or conflict with the team rewards.

Keywords: RL: Deep RL · RL: Multi-agent · RL: Policy Search

Author Information

Li Wang (Nanjing University)
Yupeng Zhang (Nanjing University)
Yujing Hu (NetEase Fuxi AI Lab)
Weixun Wang (Tianjin University)
Chongjie Zhang (Tsinghua University)
Yang Gao (Nanjing University)
Jianye Hao (Tianjin University)
Tangjie Lv (NetEase Fuxi AI Lab)
Changjie Fan (NetEase Fuxi AI Lab)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors