A Unified Theory of SGD: Variance Reduction, Sampling, Quantization and Coordinate Descent

In this paper we introduce a unified analysis of a large family of variants of proximal stochastic gradient descent ({\tt SGD}) which so far have required different intuitions, convergence analyses, have different applications, and which have been developed separately in various communities. We show...

Бүрэн тодорхойлолт

Номзүйн дэлгэрэнгүй

Үндсэн зохиолчид:	Gorbunov, Eduard, Hanzely, Filip, Richtárik, Peter
Формат:	Өгүүллэг
Хэвлэсэн:	2019
Нөхцлүүд:	Optimization and Control Machine Learning Numerical Analysis
Онлайн хандалт:	https://arxiv.org/abs/1905.11261 http://arxiv.org/abs/1905.11261
Шошгууд:	Шошго нэмэх Шошго байхгүй, Энэхүү баримтыг шошголох эхний хүн болох!