A Continuized View on Nesterov Acceleration for Stochastic Gradient Descent and Randomized Gossip

We introduce the continuized Nesterov acceleration, a close variant of Nesterov acceleration whose variables are indexed by a continuous time parameter. The two variables continuously mix following a linear ordinary differential equation and take gradient steps at random times. This continuized vari...

Fuld beskrivelse

Bibliografiske detaljer

Autores principales:	Even, Mathieu, Berthier, Raphaël, Bach, Francis, Flammarion, Nicolas, Gaillard, Pierre, Hendrikx, Hadrien, Massoulié, Laurent, Taylor, Adrien
Format:	Artículo
Udgivet:	2021
Fag:	Optimization and Control Machine Learning Multiagent Systems Probability
Online adgang:	https://arxiv.org/abs/2106.07644 http://arxiv.org/abs/2106.07644
Tags:	Tilføj Tag Ingen Tags, Vær først til at tagge denne postø!