XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models EMNLP

Davis Liang | Hila Gonen | Yuning Mao | Rui Hou | Naman Goyal | Marjan Ghazvininejad | Luke Zettlemoyer | Madian Khabsa |

The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation TACL

Naman Goyal | Cynthia Gao | Vishrav Chaudhary | Peng-Jen Chen | Guillaume Wenzek | Da Ju | Sanjana Krishnan | Marc’Aurelio Ranzato | Francisco Guzmán | Angela Fan |

Multilingual Autoregressive Entity Linking TACL

Nicola De Cao | Ledell Wu | Kashyap Popat | Mikel Artetxe | Naman Goyal | Mikhail Plekhanov | Luke Zettlemoyer | Nicola Cancedda | Sebastian Riedel | Fabio Petroni |

Lifting the Curse of Multilinguality by Pre-training Modular Transformers NAACL

Jonas Pfeiffer | Naman Goyal | Xi Lin | Xian Li | James Cross | Sebastian Riedel | Mikel Artetxe |

How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training? AMTA

Shiyue Zhang | Vishrav Chaudhary | Naman Goyal | James Cross | Guillaume Wenzek | Mohit Bansal | Francisco Guzman |

Efficient Large Scale Language Modeling with Mixtures of Experts EMNLP

Mikel Artetxe | Shruti Bhosale | Naman Goyal | Todor Mihaylov | Myle Ott | Sam Shleifer | Xi Victoria Lin | Jingfei Du | Srinivasan Iyer | Ramakanth Pasunuru | Giridharan Anantharaman | Xian Li | Shuohui Chen | Halil Akin | Mandeep Baines | Louis Martin | Xing Zhou | Punit Singh Koura | Brian O’Horo | Jeffrey Wang | Luke Zettlemoyer | Mona Diab | Zornitsa Kozareva | Veselin Stoyanov |

On the Role of Bidirectionality in Language Model Pre-Training F i n d i n g s - E M N L P

Mikel Artetxe | Jingfei Du | Naman Goyal | Luke Zettlemoyer | Veselin Stoyanov |

Few-shot Learning with Multilingual Generative Language Models EMNLP

Xi Victoria Lin | Todor Mihaylov | Mikel Artetxe | Tianlu Wang | Shuohui Chen | Daniel Simig | Myle Ott | Naman Goyal | Shruti Bhosale | Jingfei Du | Ramakanth Pasunuru | Sam Shleifer | Punit Singh Koura | Vishrav Chaudhary | Brian O’Horo | Jeff Wang | Luke Zettlemoyer | Zornitsa Kozareva | Mona Diab | Veselin Stoyanov | Xian Li |

Recipes for Building an Open-Domain Chatbot EACL

Stephen Roller | Emily Dinan | Naman Goyal | Da Ju | Mary Williamson | Yinhan Liu | Jing Xu | Myle Ott | Eric Michael Smith | Y-Lan Boureau | Jason Weston |

Larger-Scale Transformers for Multilingual Masked Language Modeling ACL IJCNLP RepL4NLP

Naman Goyal | Jingfei Du | Myle Ott | Giri Anantharaman | Alexis Conneau |

FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task ACL IJCNLP IWSLT

Yun Tang | Hongyu Gong | Xian Li | Changhan Wang | Juan Pino | Holger Schwenk | Naman Goyal |

Multilingual Translation from Denoising Pre-Training Findings

Yuqing Tang | Chau Tran | Xian Li | Peng-Jen Chen | Naman Goyal | Vishrav Chaudhary | Jiatao Gu | Angela Fan |

Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation EMNLP WMT

Guillaume Wenzek | Vishrav Chaudhary | Angela Fan | Sahir Gomez | Naman Goyal | Somya Jain | Douwe Kiela | Tristan Thrush | Francisco Guzmán |

Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data ACL IJCNLP

Wei-Jen Ko | Ahmed El-Kishky | Adithya Renduchintala | Vishrav Chaudhary | Naman Goyal | Francisco Guzmán | Pascale Fung | Philipp Koehn | Mona Diab |

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension ACL

Mike Lewis | Yinhan Liu | Naman Goyal | Marjan Ghazvininejad | Abdelrahman Mohamed | Omer Levy | Veselin Stoyanov | Luke Zettlemoyer |

Unsupervised Cross-lingual Representation Learning at Scale ACL

Alexis Conneau | Kartikay Khandelwal | Naman Goyal | Vishrav Chaudhary | Guillaume Wenzek | Francisco Guzmán | Edouard Grave | Myle Ott | Luke Zettlemoyer | Veselin Stoyanov |

Facebook AI’s WMT20 News Translation Task Submission EMNLP WMT

Peng-Jen Chen | Ann Lee | Changhan Wang | Naman Goyal | Angela Fan | Mary Williamson | Jiatao Gu |

Multilingual Denoising Pre-training for Neural Machine Translation TACL

Yinhan Liu | Jiatao Gu | Naman Goyal | Xian Li | Sergey Edunov | Marjan Ghazvininejad | Mike Lewis | Luke Zettlemoyer |

Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment EMNLP WMT

Philipp Koehn | Vishrav Chaudhary | Ahmed El-Kishky | Naman Goyal | Peng-Jen Chen | Francisco Guzmán |

LearningToQuestion at SemEval 2017 Task 3: Ranking Similar Questions by Learning to Rank Using Rich Features *SEMEVAL

Naman Goyal |

A Joint Model of Rhetorical Discourse Structure and Summarization WS

Naman Goyal | Jacob Eisenstein |