Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks ACL

Suchin Gururangan | Ana Marasović | Swabha Swayamdipta | Kyle Lo | Iz Beltagy | Doug Downey | Noah A. Smith |

SciREX: A Challenge Dataset for Document-Level Information Extraction ACL

Sarthak Jain | Madeleine van Zuylen | Hannaneh Hajishirzi | Iz Beltagy |

SPECTER: Document-level Representation Learning using Citation-informed Transformers ACL

Arman Cohan | Sergey Feldman | Iz Beltagy | Doug Downey | Daniel Weld |

SciBERT: A Pretrained Language Model for Scientific Text EMNLP

Iz Beltagy | Kyle Lo | Arman Cohan |

Pretrained Language Models for Sequential Sentence Classification EMNLP

Arman Cohan | Iz Beltagy | Daniel King | Bhavana Dalvi | Dan Weld |

Combining Distant and Direct Supervision for Neural Relation Extraction NAACL

Iz Beltagy | Kyle Lo | Waleed Ammar |

ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing ACL WS

Mark Neumann | Daniel King | Iz Beltagy | Waleed Ammar |

Construction of the Literature Graph in Semantic Scholar NAACL

Waleed Ammar | Dirk Groeneveld | Chandra Bhagavatula | Iz Beltagy | Miles Crawford | Doug Downey | Jason Dunkelberger | Ahmed Elgohary | Sergey Feldman | Vu Ha | Rodney Kinney | Sebastian Kohlmeier | Kyle Lo | Tyler Murray | Hsu-Han Ooi | Matthew Peters | Joanna Power | Sam Skjonsberg | Lucy Wang | Chris Wilhelm | Zheng Yuan | Madeleine van Zuylen | Oren Etzioni |