Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process
We consider networks, trained via stochastic gradient descent to minimize $\ell_2$ loss, with the training labels perturbed by independent noise at each iteration. We characterize the behavior of the training dynamics near any parameter vector that achieves zero training error, in terms of an implic...
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Artículo |
| Publicado: |
2019
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/1904.09080 http://arxiv.org/abs/1904.09080 |
| Etiquetas: |
Sin Etiquetas, Sea el primero en etiquetar este registro!
|