LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval NAACL

Siqi Sun | Yen-Chun Chen | Linjie Li | Shuohang Wang | Yuwei Fang | Jingjing Liu |

Cluster-Former: Clustering-based Sparse Transformer for Question Answering Findings

Shuohang Wang | Luowei Zhou | Zhe Gan | Yen-Chun Chen | Yuwei Fang | Siqi Sun | Yu Cheng | Jingjing Liu |

DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation ACL

Yizhe Zhang | Siqi Sun | Michel Galley | Yen-Chun Chen | Chris Brockett | Xiang Gao | Jianfeng Gao | Jingjing Liu | Bill Dolan |

Contrastive Distillation on Intermediate Representations for Language Model Compression EMNLP

Siqi Sun | Zhe Gan | Yuwei Fang | Yu Cheng | Shuohang Wang | Jingjing Liu |

Cross-Thought for Sentence Encoder Pre-training EMNLP

Shuohang Wang | Yuwei Fang | Siqi Sun | Zhe Gan | Yu Cheng | Jingjing Liu | Jing Jiang |

Hierarchical Graph Network for Multi-hop Question Answering EMNLP

Yuwei Fang | Siqi Sun | Zhe Gan | Rohit Pillai | Shuohang Wang | Jingjing Liu |

Patient Knowledge Distillation for BERT Model Compression EMNLP

Siqi Sun | Yu Cheng | Zhe Gan | Jingjing Liu |