Relaxation of the EM Algorithm via Quantum Annealing
Abstract
The EM algorithm is a novel numerical method to obtain maximum likelihood estimates and is often used for practical calculations. However, many of maximum likelihood estimation problems are nonconvex, and it is known that the EM algorithm fails to give the optimal estimate by being trapped by local optima. In order to deal with this difficulty, we propose a deterministic quantum annealing EM algorithm by introducing the mathematical mechanism of quantum fluctuations into the conventional EM algorithm because quantum fluctuations induce the tunnel effect and are expected to relax the difficulty of nonconvex optimization problems in the maximum likelihood estimation problems. We show a theorem that guarantees its convergence and give numerical experiments to verify its efficiency.
- Publication:
-
arXiv e-prints
- Pub Date:
- June 2016
- DOI:
- 10.48550/arXiv.1606.01484
- arXiv:
- arXiv:1606.01484
- Bibcode:
- 2016arXiv160601484M
- Keywords:
-
- Statistics - Machine Learning;
- Condensed Matter - Statistical Mechanics;
- Mathematics - Statistics Theory;
- Physics - Computational Physics;
- Quantum Physics
- E-Print:
- 6 pages, accepted to ACC 2016, minor revisions after the final submission to ACC 2016