BPDQ: Bit-Plane Decomposition Quantization on a Variable Grid for Large Language Models

Large language model inference is often bounded by memory footprint and bandwidth in resource-constrained deployments, making quantization fundamental to efficient serving. While post-training quantization (PTQ) maintains high fidelity at 4-bit, it deteriorates at 2-3 bits. In essence, existing meth...

Descripció completa

Dades bibliogràfiques

Autors principals:	Chen, Junyu, Li, Jungang, Xiong, Jing, Wang, Wenjie, Yang, Qingyao, Xiao, He, Li, Zhen, Wu, Taiqiang, Chen, Mengzhao, Peng, Zhen, Tao, Chaofan, Shi, Long, Yang, Hongxia, Wong, Ngai
Format:	Article
Publicat:	2026
Matèries:	Machine Learning
Accés en línia:	https://arxiv.org/abs/2602.04163 http://arxiv.org/abs/2602.04163
Etiquetes:	Afegir etiqueta Sense etiquetes, Sigues el primer a etiquetar aquest registre!