Deterministic quantum annealing expectation-maximization algorithm
Abstract
Maximum likelihood estimation (MLE) is one of the most important methods in machine learning, and the expectation-maximization (EM) algorithm is often used to obtain maximum likelihood estimates. However, EM heavily depends on initial configurations and fails to find the global optimum. On the other hand, in the field of physics, quantum annealing (QA) was proposed as a novel optimization approach. Motivated by QA, we propose a quantum annealing extension of EM, which we call the deterministic quantum annealing expectation-maximization (DQAEM) algorithm. We also discuss its advantage in terms of the path integral formulation. Furthermore, by employing numerical simulations, we illustrate how DQAEM works in MLE and show that DQAEM moderate the problem of local optima in EM.
- Publication:
-
Journal of Statistical Mechanics: Theory and Experiment
- Pub Date:
- November 2017
- DOI:
- 10.1088/1742-5468/aa967e
- arXiv:
- arXiv:1704.05822
- Bibcode:
- 2017JSMTE..11.3404M
- Keywords:
-
- Statistics - Machine Learning;
- Condensed Matter - Statistical Mechanics;
- Physics - Computational Physics;
- Quantum Physics
- E-Print:
- Journal of Statistical Mechanics: Theory and Experiment 2017, 113404 (2017)