Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding

Hanling Yi | Feng Lin | Hongbin Li | Ning Peiyang | Xiaotian Yu | Rong Xiao |

Paper Details:

Month: August
Year: 2024
Location: Bangkok, Thailand and virtual meeting
Venue: F | i | n | d | i | n | g | s | - | A | C | L |