Topology, Convergence, and Reconstruction of Predictive States
Abstract
Predictive equivalence in discrete stochastic processes have been applied with great success to identify randomness and structure in statistical physics and chaotic dynamical systems and to inferring hidden Markov models. We examine the conditions under which they can be reliably reconstructed from time-series data, showing that convergence of predictive states can be achieved from empirical samples in the weak topology of measures. Moreover, predictive states may be represented in Hilbert spaces that replicate the weak topology. We mathematically explain how these representations are particularly beneficial when reconstructing high-memory processes and connect them to reproducing kernel Hilbert spaces.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2021
- DOI:
- 10.48550/arXiv.2109.09203
- arXiv:
- arXiv:2109.09203
- Bibcode:
- 2021arXiv210909203L
- Keywords:
-
- Condensed Matter - Statistical Mechanics;
- Computer Science - Machine Learning;
- Mathematics - Dynamical Systems;
- Mathematics - Statistics Theory;
- Nonlinear Sciences - Chaotic Dynamics
- E-Print:
- 16 pages, 4 figures