Properties of Unique Information
Abstract
We study the measure of unique information $UI(T:X\setminus Y)$ defined by Bertschinger et al. (2014) within the framework of information decompositions. We study uniqueness and support of the solutions to the optimization problem underlying the definition of $UI$. We identify sufficient conditions for non-uniqueness of solutions with full support in terms of conditional independence constraints and in terms of the cardinalities of $T$, $X$ and $Y$. Our results are based on a reformulation of the first order conditions on the objective function as rank constraints on a matrix of conditional probabilities. These results help to speed up the computation of $UI(T:X\setminus Y)$, most notably when $T$ is binary. In the case that all variables are binary, we obtain a complete picture of where the optimizing probability distributions lie.
- Publication:
-
arXiv e-prints
- Pub Date:
- December 2019
- DOI:
- 10.48550/arXiv.1912.12505
- arXiv:
- arXiv:1912.12505
- Bibcode:
- 2019arXiv191212505R
- Keywords:
-
- Computer Science - Information Theory;
- 94A15;
- 94A17
- E-Print:
- 18 pages, one figure, 11 theorems. One author was added to acknowledge early contributions to the results. The text was improved, minor mistakes and typos were corrected. One figure was added to visualize the optimization domain