SVD based initialization: A head start for nonnegative matrix factorization
Abstract
We describe Nonnegative Double Singular Value Decomposition (NNDSVD), a new method designed to enhance the initialization stage of nonnegative matrix factorization (NMF). NNDSVD can readily be combined with existing NMF algorithms. The basic algorithm contains no randomization and is based on two SVD processes, one approximating the data matrix, the other approximating positive sections of the resulting partial SVD factors utilizing an algebraic property of unit rank matrices. Simple practical variants for NMF with dense factors are described. NNDSVD is also well suited to initialize NMF algorithms with sparse factors. Many numerical examples suggest that NNDSVD leads to rapid reduction of the approximation error of many NMF algorithms.
- Publication:
-
Pattern Recognition
- Pub Date:
- 2008
- DOI:
- 10.1016/j.patcog.2007.09.010
- Bibcode:
- 2008PatRe..41.1350B
- Keywords:
-
- NMF;
- Sparse NMF;
- SVD;
- Nonnegative matrix factorization;
- Singular value decomposition;
- Perron-Frobenius;
- Low rank;
- Structured initialization;
- Sparse factorization