Scaling Vision-Language Models with Sparse Mixture of Experts F i n d i n g s - E M N L P

Sheng Shen | Zhewei Yao | Chunyuan Li | Trevor Darrell | Kurt Keutzer | Yuxiong He |

Crosslingual Generalization through Multitask Finetuning ACL

Niklas Muennighoff | Thomas Wang | Lintang Sutawika | Adam Roberts | Stella Biderman | Teven Le Scao | M Saiful Bari | Sheng Shen | Zheng Xin Yong | Hailey Schoelkopf | Xiangru Tang | Dragomir Radev | Alham Fikri Aji | Khalid Almubarak | Samuel Albanie | Zaid Alyafeai | Albert Webson | Edward Raff | Colin Raffel |

Exposing the Limits of Video-Text Models through Contrast Sets NAACL

Jae Sung Park | Sheng Shen | Ali Farhadi | Trevor Darrell | Yejin Choi | Anna Rohrbach |

What Language Model to Train if You Have One Million GPU Hours? F i n d i n g s - E M N L P

Teven Le Scao | Thomas Wang | Daniel Hesslow | Stas Bekman | M Saiful Bari | Stella Biderman | Hady Elsahar | Niklas Muennighoff | Jason Phang | Ofir Press | Colin Raffel | Victor Sanh | Sheng Shen | Lintang Sutawika | Jaesung Tae | Zheng Xin Yong | Julien Launay | Iz Beltagy |

Noisy Self-Knowledge Distillation for Text Summarization NAACL

Yang Liu | Sheng Shen | Mirella Lapata |

Reservoir Transformers ACL IJCNLP

Sheng Shen | Alexei Baevski | Ari Morcos | Kurt Keutzer | Michael Auli | Douwe Kiela |

What’s Hidden in a One-layer Randomly Weighted Transformer? EMNLP

Sheng Shen | Zhewei Yao | Douwe Kiela | Kurt Keutzer | Michael Mahoney |

MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding EMNLP

Qinxin Wang | Hao Tan | Sheng Shen | Michael Mahoney | Zhewei Yao |

An annotated dataset of literary entities NAACL

David Bamman | Sejal Popat | Sheng Shen |

Pragmatically Informative Text Generation NAACL

Sheng Shen | Daniel Fried | Jacob Andreas | Dan Klein |