TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities ACL

Zhe Zhao | Yudong Li | Cheng Hou | Jing Zhao | Rong Tian | Weijie Liu | Yiren Chen | Ningyuan Sun | Haoyan Liu | Weiquan Mao | Han Guo | Weigang Gou | Taiqiang Wu | Tao Zhu | Wenhang Shi | Chen Chen | Shan Huang | Sihong Chen | Liqun Liu | Feifei Li | Xiaoshuai Chen | Xingwu Sun | Zhanhui Kang | Xiaoyong Du | Linlin Shen | Kimmo Yan |

Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT ACL

Jing Zhao | Yifan Wang | Junwei Bao | Youzheng Wu | Xiaodong He |

OPERA: Operation-Pivoted Discrete Reasoning over Text NAACL

Yongwei Zhou | Junwei Bao | Chaoqun Duan | Haipeng Sun | Jiahui Liang | Yifan Wang | Jing Zhao | Youzheng Wu | Xiaodong He | Tiejun Zhao |

LUNA: Learning Slot-Turn Alignment for Dialogue State Tracking NAACL

Yifan Wang | Jing Zhao | Junwei Bao | Chaoqun Duan | Youzheng Wu | Xiaodong He |

P3LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training F i n d i n g s - E M N L P

Junwei Bao | Yifan Wang | Ying Jiangyong | Yeyun Gong | Jing Zhao | Youzheng Wu | Xiaodong He |

SGG: Learning to Select, Guide, and Generate for Keyphrase Generation NAACL

Jing Zhao | Junwei Bao | Yifan Wang | Youzheng Wu | Xiaodong He | Bowen Zhou |

RoR: Read-over-Read for Long Document Machine Reading Comprehension EMNLP Findings

Jing Zhao | Junwei Bao | Yifan Wang | Yongwei Zhou | Youzheng Wu | Xiaodong He | Bowen Zhou |

Incorporating Linguistic Constraints into Keyphrase Generation ACL

Jing Zhao | Yuxiang Zhang |