LLM-FP4: 4-Bit Floating-Point Quantized Transformers

Shih-yang Liu | Zechun Liu | Xijie Huang | Pingcheng Dong | Kwang-Ting Cheng |

Paper Details:

Month: December
Year: 2023
Location: Singapore
Venue: EMNLP |