Dynabench: Rethinking Benchmarking in NLP NAACL

Douwe Kiela | Max Bartolo | Yixin Nie | Divyansh Kaushik | Atticus Geiger | Zhengxuan Wu | Bertie Vidgen | Grusha Prasad | Amanpreet Singh | Pratik Ringshia | Zhiyi Ma | Tristan Thrush | Sebastian Riedel | Zeerak Waseem | Pontus Stenetorp | Robin Jia | Mohit Bansal | Christopher Potts | Adina Williams |

Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality NAACL

Mina Lee | Chris Donahue | Robin Jia | Alexander Iyabor | Percy Liang |

Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation EMNLP

Max Bartolo | Tristan Thrush | Robin Jia | Sebastian Riedel | Pontus Stenetorp | Douwe Kiela |

Do Explanations Help Users Detect Errors in Open-Domain QA? An Evaluation of Spoken vs. Visual Explanations Findings

Ana Valeria González | Gagan Bansal | Angela Fan | Yashar Mehdad | Robin Jia | Srinivasan Iyer |

Proceedings of the 3rd Workshop on Machine Reading for Question Answering EMNLP MRQA

Adam Fisch | Alon Talmor | Danqi Chen | Eunsol Choi | Minjoon Seo | Patrick Lewis | Robin Jia | Sewon Min |

To what extent do human explanations of model behavior align with actual model behavior? BlackboxNLP EMNLP

Grusha Prasad | Yixin Nie | Mohit Bansal | Robin Jia | Douwe Kiela | Adina Williams |

Robustness and Adversarial Examples in Natural Language Processing EMNLP

Kai-Wei Chang | He He | Robin Jia | Sameer Singh |

Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards? ACL IJCNLP

Pedro Rodriguez | Joe Barrow | Alexander Miserlis Hoyle | John P. Lalor | Robin Jia | Jordan Boyd-Graber |

Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little EMNLP

Koustuv Sinha | Robin Jia | Dieuwke Hupkes | Joelle Pineau | Adina Williams | Douwe Kiela |

The statistical advantage of automatic NLG metrics at the system level ACL IJCNLP

Johnny Wei | Robin Jia |