Improve SGD Training via Aligning Mini-batches

Deep neural networks (DNNs) for supervised learning can be viewed as a pipeline of a feature extractor (i.e. last hidden layer) and a linear classifier (i.e. output layer) that is trained jointly with stochastic gradient descent (SGD). In each iteration of SGD, a mini-batch from the training data is...

Deskribapen osoa

Gorde:
Xehetasun bibliografikoak
Egile Nagusiak: Li, Xiangrui, Pan, Deng, Li, Xin, Zhu, Dongxiao
Formatua: Artikulua
Argitaratua: 2020
Gaiak:
Sarrera elektronikoa:https://arxiv.org/abs/2002.09917
http://arxiv.org/abs/2002.09917
Etiketak: Etiketa erantsi
Etiketarik gabe, Izan zaitez lehena erregistro honi etiketa jartzen!