Bayes' Bluff: Opponent Modelling in Poker
Abstract
Poker is a challenging problem for artificial intelligence, with non-deterministic dynamics, partial observability, and the added difficulty of unknown adversaries. Modelling all of the uncertainties in this domain is not an easy task. In this paper we present a Bayesian probabilistic model for a broad class of poker games, separating the uncertainty in the game dynamics from the uncertainty of the opponent's strategy. We then describe approaches to two key subproblems: (i) inferring a posterior over opponent strategies given a prior distribution and observations of their play, and (ii) playing an appropriate response to that distribution. We demonstrate the overall approach on a reduced version of poker using Dirichlet priors and then on the full game of Texas hold'em using a more informed prior. We demonstrate methods for playing effective responses to the opponent, based on the posterior.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2012
- DOI:
- 10.48550/arXiv.1207.1411
- arXiv:
- arXiv:1207.1411
- Bibcode:
- 2012arXiv1207.1411S
- Keywords:
-
- Computer Science - Computer Science and Game Theory;
- Computer Science - Artificial Intelligence
- E-Print:
- Appears in Proceedings of the Twenty-First Conference on Uncertainty in Artificial Intelligence (UAI2005)