New Riemannian preconditioned algorithms for tensor completion via polyadic decomposition
Abstract
We propose new Riemannian preconditioned algorithms for low-rank tensor completion via the polyadic decomposition of a tensor. These algorithms exploit a non-Euclidean metric on the product space of the factor matrices of the low-rank tensor in the polyadic decomposition form. This new metric is designed using an approximation of the diagonal blocks of the Hessian of the tensor completion cost function, thus has a preconditioning effect on these algorithms. We prove that the proposed Riemannian gradient descent algorithm globally converges to a stationary point of the tensor completion problem, with convergence rate estimates using the $Ł$ojasiewicz property. Numerical results on synthetic and real-world data suggest that the proposed algorithms are more efficient in memory and time compared to state-of-the-art algorithms. Moreover, the proposed algorithms display a greater tolerance for overestimated rank parameters in terms of the tensor recovery performance, thus enable a flexible choice of the rank parameter.
- Publication:
-
arXiv e-prints
- Pub Date:
- January 2021
- DOI:
- 10.48550/arXiv.2101.11108
- arXiv:
- arXiv:2101.11108
- Bibcode:
- 2021arXiv210111108D
- Keywords:
-
- Mathematics - Optimization and Control;
- Computer Science - Machine Learning;
- Mathematics - Numerical Analysis;
- 15A69;
- 90C26;
- 90C30;
- 90C52
- E-Print:
- 27 Pages, 10 figures, 4 tables