Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding

Heming Xia | Zhe Yang | Qingxiu Dong | Peiyi Wang | Yongqi Li | Tao Ge | Tianyu Liu | Wenjie Li | Zhifang Sui |

Paper Details:

Month: August
Year: 2024
Location: Bangkok, Thailand and virtual meeting
Venue: F | i | n | d | i | n | g | s | - | A | C | L |