Unified framework for information integration based on information geometry
Abstract
Measuring the degree of causal influences among multiple elements of a system is a fundamental problem in physics and biology. We propose a unified framework for quantifying any combination of causal relationships between elements in a hierarchical manner based on information geometry. Our measure of integration, called geometrical integrated information, quantifies the strength of multiple causal influences among elements by projecting the probability distribution of a system onto a constrained manifold. This measure overcomes mathematical problems of existing measures and enables an intuitive understanding of the relationships between integrated information and other measures of causal influence such as transfer entropy. Inspired by the integration of neural activity in consciousness studies, our measure should have general utility in analyzing complex systems.
- Publication:
-
Proceedings of the National Academy of Science
- Pub Date:
- December 2016
- DOI:
- 10.1073/pnas.1603583113
- arXiv:
- arXiv:1510.04455
- Bibcode:
- 2016PNAS..11314817O
- Keywords:
-
- Quantitative Biology - Neurons and Cognition;
- Computer Science - Information Theory
- E-Print:
- doi:10.1073/pnas.1603583113