Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler
Sharpness-Aware Minimization (SAM) has established itself as a powerful and widely adopted optimizer for training machine learning models. By explicitly minimizing the sharpness of the loss landscape, SAM often improves generalization while delivering strong empirical performance. However, SAM and i...
Guardat en:
| Autors principals: | , |
|---|---|
| Format: | Article |
| Publicat: |
2026
|
| Matèries: | |
| Accés en línia: | https://arxiv.org/abs/2606.01827 http://arxiv.org/abs/2606.01827 |
| Etiquetes: |
Sense etiquetes, Sigues el primer a etiquetar aquest registre!
|