Mutual information matrices are not always positive semi-definite
Abstract
For discrete random variables X_1,..., X_n we construct an n by n matrix. In the (i,j) entry we put the mutual information I(X_i;X_j) between X_i and X_j. In particular, in the (i,i) entry we put the entropy H(X_i)=I(X_i;X_i) of X_i. This matrix, called the mutual information matrix of (X_1,...,X_n), has been conjectured to be positive semi-definite. In this note, we give counterexamples to the conjecture, and show that the conjecture holds for up to three random variables.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2013
- DOI:
- 10.48550/arXiv.1307.6673
- arXiv:
- arXiv:1307.6673
- Bibcode:
- 2013arXiv1307.6673J
- Keywords:
-
- Computer Science - Information Theory;
- 94A15;
- H.1.1
- E-Print:
- 4 pages, 1 figure