Better Theory for SGD in the Nonconvex World

Large-scale nonconvex optimization problems are ubiquitous in modern machine learning, and among practitioners interested in solving them, Stochastic Gradient Descent (SGD) reigns supreme. We revisit the analysis of SGD in the nonconvex setting and propose a new variant of the recently introduced ex...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Khaled, Ahmed, Richtárik, Peter
Formato: Artículo
Publicado: 2020
Materias:
Acceso en línea:https://arxiv.org/abs/2002.03329
http://arxiv.org/abs/2002.03329
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!