A Communication-Efficient Multi-Agent Actor-Critic Algorithm for Distributed Reinforcement Learning
Abstract
This paper considers a distributed reinforcement learning problem in which a network of multiple agents aim to cooperatively maximize the globally averaged return through communication with only local neighbors. A randomized communication-efficient multi-agent actor-critic algorithm is proposed for possibly unidirectional communication relationships depicted by a directed graph. It is shown that the algorithm can solve the problem for strongly connected graphs by allowing each agent to transmit only two scalar-valued variables at one time.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2019
- DOI:
- 10.48550/arXiv.1907.03053
- arXiv:
- arXiv:1907.03053
- Bibcode:
- 2019arXiv190703053L
- Keywords:
-
- Computer Science - Machine Learning;
- Computer Science - Multiagent Systems;
- Statistics - Machine Learning