The Mutual information of LDGM codes
Abstract
We provide matching upper and lower bounds on the mutual information in noisy reconstruction of parity check codes and thereby prove a long-standing conjecture by Montanari [IEEE Transactions on Information Theory 2005]. Besides extending a prior concentration result of Abbe and Montanari [Theory of Computing 2015] to the case of odd check degrees, we precisely determine the conjectured formula for code ensembles of arbitrary degree distribution, thus capturing a broad class of capacity approaching codes.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2017
- DOI:
- 10.48550/arXiv.1707.04413
- arXiv:
- arXiv:1707.04413
- Bibcode:
- 2017arXiv170704413V
- Keywords:
-
- Computer Science - Information Theory;
- Mathematics - Probability;
- 94A17;
- 68Q87