Time's Barbed Arrow: Irreversibility, Crypticity, and Stored Information
Abstract
We show why the amount of information communicated between the past and future—the excess entropy—is not in general the amount of information stored in the present—the statistical complexity. This is a puzzle, and a long-standing one, since the former describes observed behavior, while optimal prediction requires the latter. We present a closed-form expression for the excess entropy in terms of optimal causal predictors and retrodictors—both γ machines of computational mechanics. This leads us to two new system invariants: causal irreversibility—the asymmetry between the causal representations—and crypticity—the degree to which a process hides its state information.
- Publication:
-
Physical Review Letters
- Pub Date:
- August 2009
- DOI:
- 10.1103/PhysRevLett.103.094101
- arXiv:
- arXiv:0902.1209
- Bibcode:
- 2009PhRvL.103i4101C
- Keywords:
-
- 05.45.Tp;
- 02.50.Ey;
- 05.40.-a;
- 89.70.Cf;
- Time series analysis;
- Stochastic processes;
- Fluctuation phenomena random processes noise and Brownian motion;
- Entropy and other measures of information;
- Condensed Matter - Statistical Mechanics;
- Condensed Matter - Disordered Systems and Neural Networks
- E-Print:
- 4 pages, 2 figures