Prediction, Retrodiction, and the Amount of Information Stored in the Present
Abstract
We introduce an ambidextrous view of stochastic dynamical systems, comparing their forward-time and reverse-time representations and then integrating them into a single time-symmetric representation. The perspective is useful theoretically, computationally, and conceptually. Mathematically, we prove that the excess entropy—a familiar measure of organization in complex systems—is the mutual information not only between the past and future, but also between the predictive and retrodictive causal states. Practically, we exploit the connection between prediction and retrodiction to directly calculate the excess entropy. Conceptually, these lead one to discover new system measures for stochastic dynamical systems: crypticity (information accessibility) and causal irreversibility. Ultimately, we introduce a time-symmetric representation that unifies all of these quantities, compressing the two directional representations into one. The resulting compression offers a new conception of the amount of information stored in the present.
- Publication:
-
Journal of Statistical Physics
- Pub Date:
- September 2009
- DOI:
- 10.1007/s10955-009-9808-z
- arXiv:
- arXiv:0905.3587
- Bibcode:
- 2009JSP...136.1005E
- Keywords:
-
- Stored information;
- Entropy rate;
- Statistical complexity;
- Excess entropy;
- Causal irreversibility;
- Crypticity;
- Condensed Matter - Statistical Mechanics;
- Condensed Matter - Disordered Systems and Neural Networks;
- Computer Science - Information Theory;
- Physics - Data Analysis;
- Statistics and Probability
- E-Print:
- 17 pages, 7 figures, 1 table