Model Evolution Under Zeroth-Order Optimization: A Neural Tangent Kernel Perspective

Zeroth-order (ZO) optimization enables memory-efficient training of neural networks by estimating gradients via forward passes only, eliminating the need for backpropagation. However, the stochastic nature of gradient estimation significantly obscures the training dynamics, in contrast to the well-c...

Descripción completa

Detalles Bibliográficos

Autores principales:	Zhang, Chen, Cheng, Yuxin, Ding, Chenchen, Wang, Shuqi, Lei, Jingreng, Yu, Runsheng, WU, Yik-Chung, Wong, Ngai
Formato:	Artículo
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	https://arxiv.org/abs/2603.21169 http://arxiv.org/abs/2603.21169
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!