Variational-Ising-Attention:Tailored Attention Matters for Science
Attention enables context modeling via query-key scoring with softmax normalization. Driven by industrial long-context demands, mainstream research has converged toward sparsity and efficiency, yet softmax's independence assumption persists. For scientific tasks unburdened by long-token constraints,...
Guardat en:
| Autor principal: | |
|---|---|
| Format: | Article |
| Publicat: |
2026
|
| Matèries: | |
| Accés en línia: | https://arxiv.org/abs/2607.23634 http://arxiv.org/abs/2607.23634 |
| Etiquetes: |
Sense etiquetes, Sigues el primer a etiquetar aquest registre!
|