Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora ACL BigScience

Xisen Jin | Dejiao Zhang | Henghui Zhu | Wei Xiao | Shang-Wen Li | Xiaokai Wei | Andrew Arnold | Xiang Ren |

SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities ACL

Hsiang-Sheng Tsai | Heng-Jui Chang | Wen-Chin Huang | Zili Huang | Kushal Lakhotia | Shu-wen Yang | Shuyan Dong | Andy Liu | Cheng-I Lai | Jiatong Shi | Xuankai Chang | Phil Hall | Hsuan-Jui Chen | Shang-Wen Li | Shinji Watanabe | Abdelrahman Mohamed | Hung-yi Lee |

Cooperative Self-training of Machine Reading Comprehension NAACL

Hongyin Luo | Shang-Wen Li | Mingye Gao | Seunghak Yu | James Glass |

Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora NAACL

Xisen Jin | Dejiao Zhang | Henghui Zhu | Wei Xiao | Shang-Wen Li | Xiaokai Wei | Andrew Arnold | Xiang Ren |

Meta Learning for Natural Language Processing: A Survey NAACL

Hung-yi Lee | Shang-Wen Li | Thang Vu |

DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings NAACL

Yung-Sung Chuang | Rumen Dangovski | Hongyin Luo | Yang Zhang | Shiyu Chang | Marin Soljacic | Shang-Wen Li | Scott Yih | Yoon Kim | James Glass |

Self-supervised Representation Learning for Speech Processing NAACL

Hung-yi Lee | Abdelrahman Mohamed | Shinji Watanabe | Tara Sainath | Karen Livescu | Shang-Wen Li | Shu-wen Yang | Katrin Kirchhoff |