Descent methods for Nonnegative Matrix Factorization
Abstract
In this paper, we present several descent methods that can be applied to nonnegative matrix factorization and we analyze a recently developped fast block coordinate method called Rank-one Residue Iteration (RRI). We also give a comparison of these different methods and show that the new block coordinate method has better properties in terms of approximation error and complexity. By interpreting this method as a rank-one approximation of the residue matrix, we prove that it \emph{converges} and also extend it to the nonnegative tensor factorization and introduce some variants of the method by imposing some additional controllable constraints such as: sparsity, discreteness and smoothness.
- Publication:
-
arXiv e-prints
- Pub Date:
- January 2008
- DOI:
- 10.48550/arXiv.0801.3199
- arXiv:
- arXiv:0801.3199
- Bibcode:
- 2008arXiv0801.3199H
- Keywords:
-
- Computer Science - Numerical Analysis;
- Computer Science - Information Retrieval;
- Mathematics - Optimization and Control
- E-Print:
- 47 pages. New convergence proof using damped version of RRI. To appear in Numerical Linear Algebra in Signals, Systems and Control. Accepted. Illustrating Matlab code is included in the source bundle