To Pretrain or Not to Pretrain: Examining the Benefits of Pretrainng on Resource Rich Tasks ACL

Sinong Wang | Madian Khabsa | Hao Ma |

Language Models as Fact Checkers? ACL FEVER WS

Nayeon Lee | Belinda Li | Sinong Wang | Wen-tau Yih | Hao Ma | Madian Khabsa |

Blockwise Self-Attention for Long Document Understanding EMNLP Findings

Jiezhong Qiu | Hao Ma | Omer Levy | Wen-tau Yih | Sinong Wang | Jie Tang |