Analysis of an information-theoretic model for communication
Abstract
We study the cost-minimization problem posed by Ferrer i Cancho and Solé in their model of communication that aimed at explaining the origin of Zipf’s law (2003 Proc. Nat. Acad. Sci. 100 788). Direct analysis shows that the minimum cost is min{λ,1 - λ}, where λ determines the relative weights of speaker’s and hearer’s costs in the total, as shown in several previous works using different approaches. The nature and multiplicity of the minimizing solution change discontinuously at λ = 1/2, being qualitatively different for λ < 1/2, λ > 1/2, and λ = 1/2. Zipf’s law is found only in a vanishing fraction of the minimum-cost solutions at λ = 1/2 and therefore is not explained by this model. Imposing the further condition of equal costs yields distributions substantially closer to Zipf’s law ones, but significant differences persist. We also investigate the solutions reached with the previously used minimization algorithm and find that they correctly recover global minimum states at the transition.
- Publication:
-
Journal of Statistical Mechanics: Theory and Experiment
- Pub Date:
- December 2012
- DOI:
- 10.1088/1742-5468/2012/12/P12022
- arXiv:
- arXiv:1207.0238
- Bibcode:
- 2012JSMTE..12..022D
- Keywords:
-
- Condensed Matter - Statistical Mechanics;
- Physics - Data Analysis;
- Statistics and Probability
- E-Print:
- 19 pages, 4 figures. Important references and new results added