CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Training Findings NAACL

Patrick Huber | Armen Aghajanyan | Barlas Oguz | Dmytro Okhonko | Scott Yih | Sonal Gupta | Xilun Chen |

Domain-matched Pre-training Tasks for Dense Retrieval Findings NAACL

Barlas Oguz | Kushal Lakhotia | Anchit Gupta | Patrick Lewis | Vladimir Karpukhin | Aleksandra Piktus | Xilun Chen | Sebastian Riedel | Scott Yih | Sonal Gupta | Yashar Mehdad |

UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering Findings NAACL

Barlas Oguz | Xilun Chen | Vladimir Karpukhin | Stan Peshterliev | Dmytro Okhonko | Michael Schlichtkrull | Sonal Gupta | Yashar Mehdad | Scott Yih |

Simple Local Attentions Remain Competitive for Long-Context Tasks NAACL

Wenhan Xiong | Barlas Oguz | Anchit Gupta | Xilun Chen | Diana Liskovich | Omer Levy | Scott Yih | Yashar Mehdad |