Sparse Bilinear Logistic Regression
Abstract
In this paper, we introduce the concept of sparse bilinear logistic regression for decision problems involving explanatory variables that are two-dimensional matrices. Such problems are common in computer vision, brain-computer interfaces, style/content factorization, and parallel factor analysis. The underlying optimization problem is bi-convex; we study its solution and develop an efficient algorithm based on block coordinate descent. We provide a theoretical guarantee for global convergence and estimate the asymptotical convergence rate using the Kurdyka-Łojasiewicz inequality. A range of experiments with simulated and real data demonstrate that sparse bilinear logistic regression outperforms current techniques in several important applications.
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2014
- DOI:
- 10.48550/arXiv.1404.4104
- arXiv:
- arXiv:1404.4104
- Bibcode:
- 2014arXiv1404.4104S
- Keywords:
-
- Mathematics - Optimization and Control;
- Computer Science - Computer Vision and Pattern Recognition;
- Computer Science - Machine Learning;
- 65K10;
- 68W40;
- 68Q32
- E-Print:
- 27 pages, 5 figures