Learning in nonatomic games, Part I: Finite action spaces and population games
Abstract
We examine the long-run behavior of a wide range of dynamics for learning in nonatomic games, in both discrete and continuous time. The class of dynamics under consideration includes fictitious play and its regularized variants, the best-reply dynamics (again, possibly regularized), as well as the dynamics of dual averaging / "follow the regularized leader" (which themselves include as special cases the replicator dynamics and Friedman's projection dynamics). Our analysis concerns both the actual trajectory of play and its time-average, and we cover potential and monotone games, as well as games with an evolutionarily stable state (global or otherwise). We focus exclusively on games with finite action spaces; nonatomic games with continuous action spaces are treated in detail in Part II of this paper.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2021
- DOI:
- 10.48550/arXiv.2107.01595
- arXiv:
- arXiv:2107.01595
- Bibcode:
- 2021arXiv210701595H
- Keywords:
-
- Computer Science - Computer Science and Game Theory;
- Computer Science - Machine Learning;
- Mathematics - Optimization and Control;
- Primary 91A22;
- 91A26;
- secondary 37N40;
- 68Q32
- E-Print:
- 27 pages