On Uniform Boundedness Properties of SGD and its Momentum Variants
A theoretical, and potentially also practical, problem with stochastic gradient descent is that trajectories may escape to infinity. In this note, we investigate uniform boundedness properties of iterates and function values along the trajectories of the stochastic gradient descent algorithm and its...
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Artículo |
| Publicado: |
2022
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2201.10245 http://arxiv.org/abs/2201.10245 |
| Etiquetas: |
Sin Etiquetas, Sea el primero en etiquetar este registro!
|