Structured Preconditioners in Adaptive Optimization: A Unified Analysis
We present a novel unified analysis for a broad class of adaptive optimization algorithms with structured (e.g., layerwise, diagonal, and kronecker-factored) preconditioners for both online regret minimization and offline convex optimization. Our analysis not only provides matching rate to several i...
Сохранить в:
| Главные авторы: | , , , , |
|---|---|
| Формат: | Статья |
| Опубликовано: |
2025
|
| Предметы: | |
| Online-ссылка: | https://arxiv.org/abs/2503.10537 http://arxiv.org/abs/2503.10537 |
| Метки: |
Нет меток, Требуется 1-ая метка записи!
|