ICML 2018

Timezone: »

Poster

Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents

Kaiqing Zhang · Zhuoran Yang · Han Liu · Tong Zhang · Tamer Basar

Fri Jul 13 09:15 AM -- 12:00 PM (PDT) @ Hall B #171

in Posters Fri »

We consider the fully decentralized multi-agent reinforcement learning (MARL) problem, where the agents are connected via a time-varying and possibly sparse communication network. Specifically, we assume that the reward functions of the agents might correspond to different tasks, and are only known to the corresponding agent. Moreover, each agent makes individual decisions based on both the information observed locally and the messages received from its neighbors over the network. To maximize the globally averaged return over the network, we propose two fully decentralized actor-critic algorithms, which are applicable to large-scale MARL problems in an online fashion. Convergence guarantees are provided when the value functions are approximated within the class of linear functions. Our work appears to be the first theoretical study of fully decentralized MARL algorithms for networked agents that use function approximation.

[ PDF]

Author Information

Kaiqing Zhang (University of Illinois at Urbana-Champaign (UIUC))

Zhuoran Yang (Princeton University)

Han Liu (Northwestern)

Tong Zhang (Tecent AI Lab)

Tong Zhang is a professor of Computer Science and Mathematics at the Hong Kong University of Science and Technology. His research interests are machine learning, big data and their applications. He obtained a BA in Mathematics and Computer Science from Cornell University, and a PhD in Computer Science from Stanford University. Before joining HKUST, Tong Zhang was a professor at Rutgers University, and worked previously at IBM, Yahoo as research scientists, Baidu as the director of Big Data Lab, and Tencent as the founding director of AI Lab. Tong Zhang was an ASA fellow and IMS fellow, and has served as the chair or area-chair in major machine learning conferences such as NIPS, ICML, and COLT, and has served as associate editors in top machine learning journals such as PAMI, JMLR, and Machine Learning Journal.

Tamer Basar (University of Illinois at Urbana-Champaign)

Related Events (a corresponding poster, oral, or spotlight)

2018 Oral: Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents »
Fri. Jul 13th 03:40 -- 03:50 PM Room A1