Mechanisms for a No-Regret Agent: Beyond the Common Prior
Abstract
A rich class of mechanism design problems can be understood as incomplete-information games between a principal who commits to a policy and an agent who responds, with payoffs determined by an unknown state of the world. Traditionally, these models require strong and often-impractical assumptions about beliefs (a common prior over the state). In this paper, we dispense with the common prior. Instead, we consider a repeated interaction where both the principal and the agent may learn over time from the state history. We reformulate mechanism design as a reinforcement learning problem and develop mechanisms that attain natural benchmarks without any assumptions on the state-generating process. Our results make use of novel behavioral assumptions for the agent -- centered around counterfactual internal regret -- that capture the spirit of rationality without relying on beliefs.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2020
- DOI:
- 10.48550/arXiv.2009.05518
- arXiv:
- arXiv:2009.05518
- Bibcode:
- 2020arXiv200905518C
- Keywords:
-
- Economics - Theoretical Economics;
- Computer Science - Computer Science and Game Theory
- E-Print:
- To appear in FOCS 2020