Information theory based on nonadditive information content
Abstract
We generalize Shannon's information theory in a nonadditive way by focusing on the source coding theorem. The nonadditive information content we adopted is consistent with the concept of the form invariance structure of the nonextensive entropy. Some general properties of the nonadditive information entropy are studied, in addition, the relation between the nonadditivity q and the codeword length is pointed out.
- Publication:
-
Physical Review E
- Pub Date:
- April 2001
- DOI:
- 10.1103/PhysRevE.63.046105
- arXiv:
- arXiv:cond-mat/0010074
- Bibcode:
- 2001PhRvE..63d6105Y
- Keywords:
-
- 02.50.-r;
- 05.20.-y;
- 89.70.+c;
- Probability theory stochastic processes and statistics;
- Classical statistical mechanics;
- Information theory and communication theory;
- Condensed Matter - Statistical Mechanics
- E-Print:
- 9 pages, no figures, RevTex, accepted for publication in Phys. Rev. E(an error in proof of theorem 1 was corrected, typos corrected)