A Stochastic Gradient Descent Theorem and the Back-Propagation Algorithm
Abstract
We establish a convergence theorem for a certain type of stochastic gradient descent, which leads to a convergent variant of the back-propagation algorithm
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2021
- DOI:
- arXiv:
- arXiv:2104.00539
- Bibcode:
- 2021arXiv210400539W
- Keywords:
-
- Mathematics - Optimization and Control;
- 41A60
- E-Print:
- 15 pages, 1 figure