Primal-Dual Rates and Certificates
Abstract
We propose an algorithm-independent framework to equip existing optimization methods with primal-dual certificates. Such certificates and corresponding rate of convergence guarantees are important for practitioners to diagnose progress, in particular in machine learning applications. We obtain new primal-dual convergence rates, e.g., for the Lasso as well as many L1, Elastic Net, group Lasso and TV-regularized problems. The theory applies to any norm-regularized generalized linear model. Our approach provides efficiently computable duality gaps which are globally defined, without modifying the original problems in the region of interest.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2016
- DOI:
- 10.48550/arXiv.1602.05205
- arXiv:
- arXiv:1602.05205
- Bibcode:
- 2016arXiv160205205D
- Keywords:
-
- Computer Science - Machine Learning;
- Mathematics - Optimization and Control;
- 90C46;
- 90C25;
- 49N15;
- G.1.6
- E-Print:
- appearing at ICML 2016 - Proceedings of the 33rd International Conference on Machine Learning, New York, NY, USA, 2016. JMLR: W&