Universal gradient descent
Abstract
In this book we collect many different and useful facts around gradient descent method. First of all we consider gradient descent with inexact oracle. We build a general model of optimized function that include composite optimization approach, level's methods, proximal methods etc. Then we investigate primal-dual properties of the gradient descent in general model set-up. At the end we generalize method to universal one.
- Publication:
-
arXiv e-prints
- Pub Date:
- November 2017
- DOI:
- arXiv:
- arXiv:1711.00394
- Bibcode:
- 2017arXiv171100394G
- Keywords:
-
- Mathematics - Optimization and Control
- E-Print:
- MIPT, 291 pages (in Russian)