Stochastic Optimization of PCA with Capped MSG
Abstract
We study PCA as a stochastic optimization problem and propose a novel stochastic approximation algorithm which we refer to as "Matrix Stochastic Gradient" (MSG), as well as a practical variant, Capped MSG. We study the method both theoretically and empirically.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2013
- DOI:
- 10.48550/arXiv.1307.1674
- arXiv:
- arXiv:1307.1674
- Bibcode:
- 2013arXiv1307.1674A
- Keywords:
-
- Statistics - Machine Learning;
- Computer Science - Machine Learning