Better Pre-Training by Reducing Representation Confusion F i n d i n g s - E A C L

Haojie Zhang | Mingfei Liang | Ruobing Xie | Zhenlong Sun | Bo Zhang | Leyu Lin |

Recyclable Tuning for Continual Pre-training F i n d i n g s - A C L

Yujia Qin | Cheng Qian | Xu Han | Yankai Lin | Huadong Wang | Ruobing Xie | Zhiyuan Liu | Maosong Sun | Jie Zhou |

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules F i n d i n g s - E M N L P

Chaojun Xiao | Yuqi Luo | Wenbin Zhang | Pengle Zhang | Xu Han | Yankai Lin | Zhengyan Zhang | Ruobing Xie | Zhiyuan Liu | Maosong Sun | Jie Zhou |

Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models F i n d i n g s - E M N L P

Weize Chen | Xiaoyue Xu | Xu Han | Yankai Lin | Ruobing Xie | Zhiyuan Liu | Maosong Sun | Jie Zhou |

Emergent Modularity in Pre-trained Transformers F i n d i n g s - A C L

Zhengyan Zhang | Zhiyuan Zeng | Yankai Lin | Chaojun Xiao | Xiaozhi Wang | Xu Han | Zhiyuan Liu | Ruobing Xie | Maosong Sun | Jie Zhou |

Pruning Pre-trained Language Models Without Fine-Tuning ACL

Ting Jiang | Deqing Wang | Fuzhen Zhuang | Ruobing Xie | Feng Xia |

WebCPM: Interactive Web Search for Chinese Long-form Question Answering ACL

Yujia Qin | Zihan Cai | Dian Jin | Lan Yan | Shihao Liang | Kunlun Zhu | Yankai Lin | Xu Han | Ning Ding | Huadong Wang | Ruobing Xie | Fanchao Qi | Zhiyuan Liu | Maosong Sun | Jie Zhou |

Prompt Tuning for Discriminative Pre-trained Language Models ACL Findings

Yuan Yao | Bowen Dong | Ao Zhang | Zhengyan Zhang | Ruobing Xie | Zhiyuan Liu | Leyu Lin | Maosong Sun | Jianyong Wang |

Open Hierarchical Relation Extraction NAACL

Kai Zhang | Yuan Yao | Ruobing Xie | Xu Han | Zhiyuan Liu | Fen Lin | Leyu Lin | Maosong Sun |

Incorporating Global Information in Local Attention for Knowledge Representation Learning Findings

Yu Zhao | Han Zhou | Ruobing Xie | Fuzhen Zhuang | Qing Li | Ji Liu |

Connecting Embeddings for Knowledge Graph Entity Typing ACL

Yu Zhao | anxiang zhang | Ruobing Xie | Kang Liu | Xiaojie WANG |

Meta-Information Guided Meta-Learning for Few-Shot Relation Classification COLING

Bowen Dong | Yuan Yao | Ruobing Xie | Tianyu Gao | Xu Han | Zhiyuan Liu | Fen Lin | Leyu Lin | Maosong Sun |

Denoising Relation Extraction from Document-level Distant Supervision EMNLP

Chaojun Xiao | Yuan Yao | Ruobing Xie | Xu Han | Zhiyuan Liu | Maosong Sun | Fen Lin | Leyu Lin |

Open Relation Extraction: Relational Knowledge Transfer from Supervised Data to Unsupervised Data EMNLP

Ruidong Wu | Yuan Yao | Xu Han | Ruobing Xie | Zhiyuan Liu | Fen Lin | Leyu Lin | Maosong Sun |

Cross-lingual Lexical Sememe Prediction EMNLP

Fanchao Qi | Yankai Lin | Maosong Sun | Hao Zhu | Ruobing Xie | Zhiyuan Liu |

Language Modeling with Sparse Product of Sememe Experts EMNLP

Yihong Gu | Jun Yan | Hao Zhu | Zhiyuan Liu | Ruobing Xie | Maosong Sun | Fen Lin | Leyu Lin |

Incorporating Chinese Characters of Words for Lexical Sememe Prediction ACL

Huiming Jin | Hao Zhu | Zhiyuan Liu | Ruobing Xie | Maosong Sun | Fen Lin | Leyu Lin |

Improved Word Representation Learning with Sememes ACL

Yilin Niu | Ruobing Xie | Zhiyuan Liu | Maosong Sun |