Test-Time Training with KV Binding Is Secretly Linear Attention

Test-time training (TTT) with KV binding as sequence modeling layer is commonly interpreted as a form of online meta-learning that memorizes a key-value mapping at test time. However, our analysis reveals multiple phenomena that contradict this memorization-based interpretation. Motivated by these f...

Descripción completa

Detalles Bibliográficos

Autores principales:	Liu, Junchen, Elflein, Sven, Litany, Or, Gojcic, Zan, Li, Ruilong
Formato:	Artículo
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Acceso en línea:	https://arxiv.org/abs/2602.21204 http://arxiv.org/abs/2602.21204
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!