PAC-Bayes Iterated Logarithm Bounds for Martingale Mixtures
Abstract
We give tight concentration bounds for mixtures of martingales that are simultaneously uniform over (a) mixture distributions, in a PAC-Bayes sense; and (b) all finite times. These bounds are proved in terms of the martingale variance, extending classical Bernstein inequalities, and sharpening and simplifying prior work.
- Publication:
-
arXiv e-prints
- Pub Date:
- June 2015
- DOI:
- 10.48550/arXiv.1506.06573
- arXiv:
- arXiv:1506.06573
- Bibcode:
- 2015arXiv150606573B
- Keywords:
-
- Computer Science - Machine Learning;
- Mathematics - Probability;
- Statistics - Machine Learning