Efficient Methods for Natural Language Processing: A Survey TACL

Marcos Treviso | Ji-Ung Lee | Tianchu Ji | Betty van Aken | Qingqing Cao | Manuel R. Ciosici | Michael Hassid | Kenneth Heafield | Sara Hooker | Colin Raffel | Pedro H. Martins | André F. T. Martins | Jessica Zosa Forde | Peter Milder | Edwin Simpson | Noam Slonim | Jesse Dodge | Emma Strubell | Niranjan Balasubramanian | Leon Derczynski | Iryna Gurevych | Roy Schwartz |

Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings ACL

Daniel Rotem | Michael Hassid | Jonathan Mamou | Roy Schwartz |

How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers F i n d i n g s - E M N L P

Michael Hassid | Hao Peng | Daniel Rotem | Jungo Kasai | Ivan Montero | Noah A. Smith | Roy Schwartz |