Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora

Xisen Jin | Dejiao Zhang | Henghui Zhu | Wei Xiao | Shang-Wen Li | Xiaokai Wei | Andrew Arnold | Xiang Ren |

Paper Details:

Month: May
Year: 2022
Location: virtual+Dublin
Venue: ACL | BigScience |

Citations

URL