Non-asymptotic Estimates for Markov Transition Matrices with Rigorous Error Bounds
Abstract
We establish non-asymptotic error bounds for the classical Maximal Likelihood Estimation of the transition matrix of a given Markov chain. Meanwhile, in the reversible case, we propose a new reversibility-preserving online Symmetric Counting Estimation of the transition matrix with non-asymptotic deviation bounds. Our analysis is based on a convergence study of certain Markov chains on the length-2 path spaces induced by the original Markov chain.
- Publication:
-
arXiv e-prints
- Pub Date:
- August 2024
- DOI:
- 10.48550/arXiv.2408.05963
- arXiv:
- arXiv:2408.05963
- Bibcode:
- 2024arXiv240805963H
- Keywords:
-
- Mathematics - Statistics Theory;
- Mathematics - Probability;
- 60J10;
- 37A25;
- 62M05
- E-Print:
- 21 pages, 7 figures