XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference

Joao Monteiro | Étienne Marcotte | Pierre-Andre Noel | Valentina Zantedeschi | David Vazquez | Nicolas Chapados | Christopher Pal | Perouz Taslakian |

Paper Details:

Month: November
Year: 2024
Location: Miami, Florida, USA
Venue: F | i | n | d | i | n | g | s | - | E | M | N | L | P |

Citations

URL

No Citations Yet

Field Of Study