Tokenization Falling Short: On Subword Robustness in Large Language Models

Yekun Chai | Yewei Fang | Qiwei Peng | Xuhong Li |

Paper Details:

Month: November
Year: 2024
Location: Miami, Florida, USA
Venue: F | i | n | d | i | n | g | s | - | E | M | N | L | P |

Citations

URL

No Citations Yet

Field Of Study