Global stability of first-order methods for coercive tame functions
Abstract
We consider first-order methods with constant step size for minimizing locally Lipschitz coercive functions that are tame in an o-minimal structure on the real field. We prove that if the method is approximated by subgradient trajectories, then the iterates eventually remain in a neighborhood of a connected component of the set of critical points. Under suitable method-dependent regularity assumptions, this result applies to the subgradient method with momentum, the stochastic subgradient method with random reshuffling and momentum, and the random-permutations cyclic coordinate descent method.
- Publication:
-
arXiv e-prints
- Pub Date:
- August 2023
- DOI:
- 10.48550/arXiv.2308.00899
- arXiv:
- arXiv:2308.00899
- Bibcode:
- 2023arXiv230800899J
- Keywords:
-
- Mathematics - Optimization and Control
- E-Print:
- 30 pages, 1 figure