Strong replica symmetry for high-dimensional disordered log-concave Gibbs measures
Abstract
We consider a generic class of log-concave, possibly random, (Gibbs) measures. We prove the concentration of an infinite family of order parameters called multioverlaps. Because they completely parametrise the quenched Gibbs measure of the system, this implies a simple representation of the asymptotic Gibbs measures, as well as the decoupling of the variables in a strong sense. These results may prove themselves useful in several contexts. In particular in machine learning and high-dimensional inference, log-concave measures appear in convex empirical risk minimisation, maximum a-posteriori inference or M-estimation. We believe that they may be applicable in establishing some type of "replica symmetric formulas" for the free energy, inference or generalisation error in such settings.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2020
- DOI:
- 10.48550/arXiv.2009.12939
- arXiv:
- arXiv:2009.12939
- Bibcode:
- 2020arXiv200912939B
- Keywords:
-
- Mathematics - Probability;
- Condensed Matter - Disordered Systems and Neural Networks;
- Computer Science - Information Theory;
- Computer Science - Machine Learning;
- Mathematical Physics
- E-Print:
- Inf. Inference, 11, no. 3 (2022) 1079-1108