How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers

Michael Hassid | Hao Peng | Daniel Rotem | Jungo Kasai | Ivan Montero | Noah A. Smith | Roy Schwartz |

Paper Details:

Month: December
Year: 2022
Location: Abu Dhabi, United Arab Emirates
Venue: F | i | n | d | i | n | g | s | - | E | M | N | L | P |

Citations

URL

No Citations Yet

Field Of Study