CLiMP: A Benchmark for Chinese Language Model Evaluation EACL

Beilei Xiang | Changbing Yang | Yu Li | Alex Warstadt | Katharina Kann |

When Do You Need Billions of Words of Pretraining Data? ACL IJCNLP

Yian Zhang | Alex Warstadt | Xiaocheng Li | Samuel R. Bowman |

What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks? ACL IJCNLP

Nikita Nangia | Saku Sugawara | Harsh Trivedi | Alex Warstadt | Clara Vania | Samuel R. Bowman |

NOPE: A Corpus of Naturally-Occurring Presuppositions in English CoNLL EMNLP

Alicia Parrish | Sebastian Schuster | Alex Warstadt | Omar Agha | Soo-Hwan Lee | Zhuoye Zhao | Samuel R. Bowman | Tal Linzen |

Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition ACL

Paloma Jeretic | Alex Warstadt | Suvrat Bhooshan | Adina Williams |

BLiMP: The Benchmark of Linguistic Minimal Pairs for English TACL

Alex Warstadt | Alicia Parrish | Haokun Liu | Anhad Mohananey | Wei Peng | Sheng-Fu Wang | Samuel R. Bowman |

Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually) EMNLP

Alex Warstadt | Yian Zhang | Xiaocheng Li | Haokun Liu | Samuel R. Bowman |

Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs EMNLP

Alex Warstadt | Yu Cao | Ioana Grosu | Wei Peng | Hagen Blix | Yining Nie | Anna Alsop | Shikha Bordia | Haokun Liu | Alicia Parrish | Sheng-Fu Wang | Jason Phang | Anhad Mohananey | Phu Mon Htut | Paloma Jeretic | Samuel R. Bowman |

Verb Argument Structure Alternations in Word and Sentence Embeddings SCiL WS

Katharina Kann | Alex Warstadt | Adina Williams | Samuel R. Bowman |

Neural Network Acceptability Judgments TACL

Alex Warstadt | Amanpreet Singh | Samuel R. Bowman |