Adding Instructions during Pretraining: Effective way of Controlling Toxicity in Language Models EACL

Shrimai Prabhumoye | Mostofa Patwary | Mohammad Shoeybi | Bryan Catanzaro |

Context Generation Improves Open Domain Question Answering F i n d i n g s - E A C L

Dan Su | Mostofa Patwary | Shrimai Prabhumoye | Peng Xu | Ryan Prenger | Mohammad Shoeybi | Pascale Fung | Anima Anandkumar | Bryan Catanzaro |

Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning F i n d i n g s - E M N L P

Zhuolin Yang | Wei Ping | Zihan Liu | Vijay Korthikanti | Weili Nie | De-An Huang | Linxi Fan | Zhiding Yu | Shiyi Lan | Bo Li | Mohammad Shoeybi | Ming-Yu Liu | Yuke Zhu | Bryan Catanzaro | Chaowei Xiao | Anima Anandkumar |

Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study EMNLP

Boxin Wang | Wei Ping | Peng Xu | Lawrence McAfee | Zihan Liu | Mohammad Shoeybi | Yi Dong | Oleksii Kuchaiev | Bo Li | Chaowei Xiao | Anima Anandkumar | Bryan Catanzaro |

Multi-Stage Prompting for Knowledgeable Dialogue Generation ACL Findings

Zihan Liu | Mostofa Patwary | Ryan Prenger | Shrimai Prabhumoye | Wei Ping | Mohammad Shoeybi | Bryan Catanzaro |

Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models F i n d i n g s - E M N L P

David Wingate | Mohammad Shoeybi | Taylor Sorensen |

Evaluating Parameter Efficient Learning for Generation EMNLP

Peng Xu | Mostofa Patwary | Shrimai Prabhumoye | Virginia Adams | Ryan Prenger | Wei Ping | Nayeon Lee | Mohammad Shoeybi | Bryan Catanzaro |

End-to-End Training of Neural Retrievers for Open-Domain Question Answering ACL IJCNLP

Devendra Sachan | Mostofa Patwary | Mohammad Shoeybi | Neel Kant | Wei Ping | William L. Hamilton | Bryan Catanzaro |

Large Scale Multi-Actor Generative Dialog Modeling ACL

Alex Boyd | Raul Puri | Mohammad Shoeybi | Mostofa Patwary | Bryan Catanzaro |

MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models EMNLP

Peng Xu | Mostofa Patwary | Mohammad Shoeybi | Raul Puri | Pascale Fung | Anima Anandkumar | Bryan Catanzaro |

BioMegatron: Larger Biomedical Domain Language Model EMNLP

Hoo-Chang Shin | Yang Zhang | Evelina Bakhturina | Raul Puri | Mostofa Patwary | Mohammad Shoeybi | Raghav Mani |

Training Question Answering Models From Synthetic Data EMNLP

Raul Puri | Ryan Spring | Mohammad Shoeybi | Mostofa Patwary | Bryan Catanzaro |