Taylor series expansions for the entropy rate of Hidden Markov Processes
Abstract
Finding the entropy rate of Hidden Markov Processes is an active research topic, of both theoretical and practical importance. A recently used approach is studying the asymptotic behavior of the entropy rate in various regimes. In this paper we generalize and prove a previous conjecture relating the entropy rate to entropies of finite systems. Building on our new theorems, we establish series expansions for the entropy rate in two different regimes. We also study the radius of convergence of the two series expansions.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2005
- DOI:
- 10.48550/arXiv.cs/0510005
- arXiv:
- arXiv:cs/0510005
- Bibcode:
- 2005cs.......10005Z
- Keywords:
-
- Computer Science - Information Theory;
- Condensed Matter - Statistical Mechanics
- E-Print:
- Proceedings 2006 IEEE International Conference on Communications (ICC 2006).