Improve SGD Training via Aligning Mini-batches
Deep neural networks (DNNs) for supervised learning can be viewed as a pipeline of a feature extractor (i.e. last hidden layer) and a linear classifier (i.e. output layer) that is trained jointly with stochastic gradient descent (SGD). In each iteration of SGD, a mini-batch from the training data is...
Gorde:
| Egile Nagusiak: | , , , |
|---|---|
| Formatua: | Artikulua |
| Argitaratua: |
2020
|
| Gaiak: | |
| Sarrera elektronikoa: | https://arxiv.org/abs/2002.09917 http://arxiv.org/abs/2002.09917 |
| Etiketak: |
Etiketarik gabe, Izan zaitez lehena erregistro honi etiketa jartzen!
|