Pattern recognition in Deep Boltzmann machines
Abstract
We consider a multi-layer Sherrington-Kirkpatrick spin-glass as a model for deep restricted Boltzmann machines and we solve for its quenched free energy, in the thermodynamic limit and allowing for a first step of replica symmetry breaking. This result is accomplished rigorously exploiting interpolating techniques and recovering the expression already known for the replica-symmetry case. Further, we drop the restriction constraint by introducing intra-layer connections among spins and we show that the resulting system can be mapped into a modular Hopfield network, which is also addressed rigorously via interpolating techniques up to the first step of replica symmetry breaking.
- Publication:
-
arXiv e-prints
- Pub Date:
- June 2021
- DOI:
- 10.48550/arXiv.2106.08978
- arXiv:
- arXiv:2106.08978
- Bibcode:
- 2021arXiv210608978A
- Keywords:
-
- Condensed Matter - Disordered Systems and Neural Networks;
- Mathematical Physics
- E-Print:
- 24 pages, 2 figures