Notes on computational-to-statistical gaps: predictions using statistical physics
Abstract
In these notes we describe heuristics to predict computational-to-statistical gaps in certain statistical problems. These are regimes in which the underlying statistical problem is information-theoretically possible although no efficient algorithm exists, rendering the problem essentially unsolvable for large instances. The methods we describe here are based on mature, albeit non-rigorous, tools from statistical physics. These notes are based on a lecture series given by the authors at the Courant Institute of Mathematical Sciences in New York City, on May 16th, 2017.
- Publication:
-
arXiv e-prints
- Pub Date:
- March 2018
- DOI:
- 10.48550/arXiv.1803.11132
- arXiv:
- arXiv:1803.11132
- Bibcode:
- 2018arXiv180311132B
- Keywords:
-
- Statistics - Machine Learning;
- Computer Science - Data Structures and Algorithms;
- Computer Science - Machine Learning
- E-Print:
- 22 pages, 2 figures