Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity

Michael R. Metel | Peng Lu | Boxing Chen | Mehdi Rezagholizadeh | Ivan Kobyzev |

Paper Details:

Month: November
Year: 2024
Location: Miami, Florida, USA
Venue: F | i | n | d | i | n | g | s | - | E | M | N | L | P |

Citations

URL

No Citations Yet

No URLs Found

Field Of Study