Equal-image-size source partitioning: Creating strong Fano's inequalities for multi-terminal discrete memoryless channels
Abstract
This paper introduces equal-image-size source partitioning, a new tool for analyzing channel and joint source-channel coding in a multi-terminal discrete memoryless channel environment. Equal-image-size source partitioning divides the source (combination of messages and codewords) into a sub-exponential number of subsets. Over each of these subsets, the exponential orders of the minimum image sizes of most messages are roughly equal to the same entropy term. This property gives us the strength of minimum image sizes and the flexibility of entropy terms. Using the method of equal-image-size source partitioning, we prove separate necessary conditions for the existence of average-error and maximum-error codes. These necessary conditions are much stronger than the standard Fano's inequality, and can be weakened to render versions of Fano's inequality that apply to codes with non-vanishing error probabilities. To demonstrate the power of this new tool, we employ the stronger average-error version of Fano's inequality to prove the strong converse for the discrete memoryless wiretap channel with decaying leakage, which heretofore has been an open problem.
- Publication:
-
arXiv e-prints
- Pub Date:
- December 2015
- DOI:
- 10.48550/arXiv.1512.00824
- arXiv:
- arXiv:1512.00824
- Bibcode:
- 2015arXiv151200824G
- Keywords:
-
- Computer Science - Information Theory
- E-Print:
- Submitted to IEEE trans info theory. Presented in part at the 2014 International Symposium on Information Theory (ISIT) in Honolulu, HI, USA. 29 pages, 1 example. Comments welcome. This version fixes a mistake in the application example and corrects a number of typos