BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL

DaYou Du | Yijia Zhang | Shijie Cao | Jiaqi Guo | Ting Cao | Xiaowen Chu | Ningyi Xu |

AFPQ: Asymmetric Floating Point Quantization for LLMs F i n d i n g s - A C L

Yijia Zhang | Sicheng Zhang | Shijie Cao | DaYou Du | Jianyu Wei | Ting Cao | Ningyi Xu |

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models EMNLP

Yifei Liu | Jicheng Wen | Yang Wang | Shengyu Ye | Li Lyna Zhang | Ting Cao | Cheng Li | Mao Yang |