On the token distance modeling ability of higher RoPE attention dimension

Xiangyu Hong | Che Jiang | Biqing Qi | Fandong Meng | Mo Yu | Bowen Zhou | Jie Zhou |

Paper Details:

Month: November
Year: 2024
Location: Miami, Florida, USA
Venue: F | i | n | d | i | n | g | s | - | E | M | N | L | P |

Citations

URL

No Citations Yet

No URLs Found

Field Of Study