Anatomy of a bit: Information in a time series observation
Abstract
Appealing to several multivariate information measures—some familiar, some new here—we analyze the information embedded in discrete-valued stochastic time series. We dissect the uncertainty of a single observation to demonstrate how the measures' asymptotic behavior sheds structural and semantic light on the generating process's internal information dynamics. The measures scale with the length of time window, which captures both intensive (rates of growth) and subextensive components. We provide interpretations for the components, developing explicit relationships between them. We also identify the informational component shared between the past and the future that is not contained in a single observation. The existence of this component directly motivates the notion of a process's effective (internal) states and indicates why one must build models.
- Publication:
-
Chaos
- Pub Date:
- September 2011
- DOI:
- 10.1063/1.3637494
- arXiv:
- arXiv:1105.2988
- Bibcode:
- 2011Chaos..21c7109J
- Keywords:
-
- stochastic processes;
- time series;
- 05.40.-a;
- 02.50.Ey;
- 05.45.Tp;
- 05.10.Gg;
- Fluctuation phenomena random processes noise and Brownian motion;
- Stochastic processes;
- Time series analysis;
- Stochastic analysis methods;
- Computer Science - Information Theory;
- Condensed Matter - Statistical Mechanics;
- Mathematics - Statistics Theory;
- Nonlinear Sciences - Adaptation and Self-Organizing Systems
- E-Print:
- 15 pages, 12 figures, 2 tables