Maximizing Multi-Information
Abstract
Stochastic interdependence of a probablility distribution on a product space is measured by its Kullback-Leibler distance from the exponential family of product distributions (called multi-information). Here we investigate low-dimensional exponential families that contain the maximizers of stochastic interdependence in their closure. Based on a detailed description of the structure of probablility distributions with globally maximal multi-information we obtain our main result: The exponential family of pure pair-interactions contains all global maximizers of the multi-information in its closure.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2007
- DOI:
- 10.48550/arXiv.math-ph/0702002
- arXiv:
- arXiv:math-ph/0702002
- Bibcode:
- 2007math.ph...2002A
- Keywords:
-
- Mathematical Physics;
- 82C32;
- 92B20;
- 94A15
- E-Print:
- 22 pages, 4 figures