Quantifying Redundant Information in Predicting a Target Random Variable
Abstract
We consider the problem of defining a measure of redundant information that quantifies how much common information two or more random variables specify about a target random variable. We discussed desired properties of such a measure, and propose new measures with some desirable properties.
- Publication:
-
Entropy
- Pub Date:
- July 2015
- DOI:
- 10.3390/e17074644
- arXiv:
- arXiv:1411.4732
- Bibcode:
- 2015Entrp..17.4644G
- Keywords:
-
- synergy;
- information theory;
- complex systems;
- irreducibility;
- synergistic information;
- intersection-information;
- Computer Science - Information Theory
- E-Print:
- 6 pages, 6 figures