Investigating Efficiently Extending Transformers for Long Input Summarization EMNLP

Jason Phang | Yao Zhao | Peter Liu |

What Do NLP Researchers Believe? Results of the NLP Community Metasurvey ACL

Julian Michael | Ari Holtzman | Alicia Parrish | Aaron Mueller | Alex Wang | Angelica Chen | Divyam Madaan | Nikita Nangia | Richard Yuanzhe Pang | Jason Phang | Samuel R. Bowman |

GPT-NeoX-20B: An Open-Source Autoregressive Language Model ACL BigScience

Sidney Black | Stella Biderman | Eric Hallahan | Quentin Anthony | Leo Gao | Laurence Golding | Horace He | Connor Leahy | Kyle McDonell | Jason Phang | Michael Pieler | Usvsn Sai Prashanth | Shivanshu Purohit | Laria Reynolds | Jonathan Tow | Ben Wang | Samuel Weinbach |

Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions ACL LNLS

Alicia Parrish | Harsh Trivedi | Ethan Perez | Angelica Chen | Nikita Nangia | Jason Phang | Samuel Bowman |

BBQ: A hand-built bias benchmark for question answering ACL Findings

Alicia Parrish | Angelica Chen | Nikita Nangia | Vishakh Padmakumar | Jason Phang | Jana Thompson | Phu Mon Htut | Samuel Bowman |

Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair DADC NAACL

Jason Phang | Angelica Chen | William Huang | Samuel R. Bowman |

QuALITY: Question Answering with Long Input Texts, Yes! NAACL

Richard Yuanzhe Pang | Alicia Parrish | Nitish Joshi | Nikita Nangia | Jason Phang | Angelica Chen | Vishakh Padmakumar | Johnny Ma | Jana Thompson | He He | Samuel Bowman |

What Language Model to Train if You Have One Million GPU Hours? F i n d i n g s - E M N L P

Teven Le Scao | Thomas Wang | Daniel Hesslow | Stas Bekman | M Saiful Bari | Stella Biderman | Hady Elsahar | Niklas Muennighoff | Jason Phang | Ofir Press | Colin Raffel | Victor Sanh | Sheng Shen | Lintang Sutawika | Jaesung Tae | Zheng Xin Yong | Julien Launay | Iz Beltagy |

SQuALITY: Building a Long-Document Summarization Dataset the Hard Way EMNLP

Alex Wang | Richard Yuanzhe Pang | Angelica Chen | Jason Phang | Samuel R. Bowman |

Comparing Test Sets with Item Response Theory ACL IJCNLP

Clara Vania | Phu Mon Htut | William Huang | Dhara Mungra | Richard Yuanzhe Pang | Jason Phang | Haokun Liu | Kyunghyun Cho | Samuel R. Bowman |

Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers BlackboxNLP EMNLP

Jason Phang | Haokun Liu | Samuel R. Bowman |

jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models ACL

Yada Pruksachatkun | Phil Yeres | Haokun Liu | Jason Phang | Phu Mon Htut | Alex Wang | Ian Tenney | Samuel R. Bowman |

Intermediate-Task Transfer Learning with Pretrained Language Models: When and Why Does It Work? ACL

Yada Pruksachatkun | Jason Phang | Haokun Liu | Phu Mon Htut | Xiaoyi Zhang | Richard Yuanzhe Pang | Clara Vania | Katharina Kann | Samuel R. Bowman |

English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too AACL

Jason Phang | Iacer Calixto | Phu Mon Htut | Yada Pruksachatkun | Haokun Liu | Clara Vania | Katharina Kann | Samuel R. Bowman |

Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs EMNLP

Alex Warstadt | Yu Cao | Ioana Grosu | Wei Peng | Hagen Blix | Yining Nie | Anna Alsop | Shikha Bordia | Haokun Liu | Alicia Parrish | Sheng-Fu Wang | Jason Phang | Anhad Mohananey | Phu Mon Htut | Paloma Jeretic | Samuel R. Bowman |

Unsupervised Sentence Compression using Denoising Auto-Encoders CoNLL

Thibault Fevry | Jason Phang |