Tight Bounds for Symmetric Divergence Measures and a Refined Bound for Lossless Source Coding
Abstract
Tight bounds for several symmetric divergence measures are derived in terms of the total variation distance. It is shown that each of these bounds is attained by a pair of 2 or 3-element probability distributions. An application of these bounds for lossless source coding is provided, refining and improving a certain bound by Csiszár. Another application of these bounds has been recently introduced by Yardi. et al. for channel-code detection.
- Publication:
-
arXiv e-prints
- Pub Date:
- March 2014
- DOI:
- 10.48550/arXiv.1403.7164
- arXiv:
- arXiv:1403.7164
- Bibcode:
- 2014arXiv1403.7164S
- Keywords:
-
- Computer Science - Information Theory;
- Mathematics - Probability
- E-Print:
- Appears in the IEEE Trans. on Information Theory, February 2015. arXiv admin note: substantial text overlap with arXiv:1502.06428