Dropping the Anchor: Statistical Context Summarization for Distributed Systems via Pulsar Attention
Inference with large language models (LLMs) on long sequences is computationally expensive due to the quadratic complexity of self-attention. Distributed blockwise methods such as Star Attention reduce this cost by sharding context across hosts, but rely on prepending a static, content-blind copy of...
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Artículo |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2607.20457 http://arxiv.org/abs/2607.20457 |
| Etiquetas: |
Sin Etiquetas, Sea el primero en etiquetar este registro!
|