Bregman Distance to L1 Regularized Logistic Regression
Abstract
In this work we investigate the relationship between Bregman distances and regularized Logistic Regression model. We present a detailed study of Bregman Distance minimization, a family of generalized entropy measures associated with convex functions. We convert the L1-regularized logistic regression into this more general framework and propose a primal-dual method based algorithm for learning the parameters. We pose L1-regularized logistic regression into Bregman distance minimization and then apply non-linear constrained optimization techniques to estimate the parameters of the logistic model.
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2010
- DOI:
- 10.48550/arXiv.1004.3814
- arXiv:
- arXiv:1004.3814
- Bibcode:
- 2010arXiv1004.3814D
- Keywords:
-
- Computer Science - Machine Learning
- E-Print:
- 8 pages, 3 images, shorter version published in ICPR 2008 by same authors.