Improving Multi-agent Coordination by Learning to Estimate Contention
Abstract
We present a multi-agent learning algorithm, ALMA-Learning, for efficient and fair allocations in large-scale systems. We circumvent the traditional pitfalls of multi-agent learning (e.g., the moving target problem, the curse of dimensionality, or the need for mutually consistent actions) by relying on the ALMA heuristic as a coordination mechanism for each stage game. ALMA-Learning is decentralized, observes only own action/reward pairs, requires no inter-agent communication, and achieves near-optimal (<5% loss) and fair coordination in a variety of synthetic scenarios and a real-world meeting scheduling problem. The lightweight nature and fast learning constitute ALMA-Learning ideal for on-device deployment.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 2021
- DOI:
- 10.48550/arXiv.2105.04027
- arXiv:
- arXiv:2105.04027
- Bibcode:
- 2021arXiv210504027D
- Keywords:
-
- Computer Science - Multiagent Systems;
- Computer Science - Artificial Intelligence
- E-Print:
- Accepted to the 30th International Joint Conference on Artificial Intelligence (IJCAI-21)