TQL: Scaling Q-Functions with Transformers by Preventing Attention Collapse

Despite scale driving substantial recent advancements in machine learning, reinforcement learning (RL) methods still primarily use small value functions. Naively scaling value functions -- including with a transformer architecture, which is known to be highly scalable -- often results in learning in...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Dong, Perry, Hung, Kuo-Han, Swerdlow, Alexander, Sadigh, Dorsa, Finn, Chelsea
Formato: Artículo
Publicado: 2026
Materias:
Acceso en línea:https://arxiv.org/abs/2602.01439
http://arxiv.org/abs/2602.01439
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!