Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? F i n d i n g s - E M N L P

Yi Tay | Mostafa Dehghani | Samira Abnar | Hyung Chung | William Fedus | Jinfeng Rao | Sharan Narang | Vinh Tran | Dani Yogatama | Donald Metzler |

How Does Generative Retrieval Scale to Millions of Passages? EMNLP

Ronak Pradeep | Kai Hui | Jai Gupta | Adam Lelkes | Honglei Zhuang | Jimmy Lin | Donald Metzler | Vinh Tran |

PaRaDe: Passage Ranking using Demonstrations with LLMs F i n d i n g s - E M N L P

Andrew Drozdov | Honglei Zhuang | Zhuyun Dai | Zhen Qin | Razieh Rahimi | Xuanhui Wang | Dana Alon | Mohit Iyyer | Andrew McCallum | Donald Metzler | Kai Hui |

DSI++: Updating Transformer Memory with New Documents EMNLP

Sanket Vaibhav Mehta | Jai Gupta | Yi Tay | Mostafa Dehghani | Vinh Q. Tran | Jinfeng Rao | Marc Najork | Emma Strubell | Donald Metzler |

Transcending Scaling Laws with 0.1% Extra Compute EMNLP

Yi Tay | Jason Wei | Hyung Chung | Vinh Tran | David So | Siamak Shakeri | Xavier Garcia | Steven Zheng | Jinfeng Rao | Aakanksha Chowdhery | Denny Zhou | Donald Metzler | Slav Petrov | Neil Houlsby | Quoc Le | Mostafa Dehghani |

LAIT: Efficient Multi-Segment Encoding in Transformers with Layer-Adjustable Interaction ACL

Jeremiah Milbauer | Annie Louis | Mohammad Javad Hosseini | Alex Fabrikant | Donald Metzler | Tal Schuster |

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference ACL Findings

Kai Hui | Honglei Zhuang | Tao Chen | Zhen Qin | Jing Lu | Dara Bahri | Ji Ma | Jai Gupta | Cicero Nogueira dos Santos | Yi Tay | Donald Metzler |

Stretching Sentence-pair NLI Models to Reason over Long Documents and Clusters F i n d i n g s - E M N L P

Tal Schuster | Sihao Chen | Senaka Buthpitiya | Alex Fabrikant | Donald Metzler |

Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification EMNLP

Jai Gupta | Yi Tay | Chaitanya Kamath | Vinh Tran | Donald Metzler | Shailesh Bavadekar | Mimi Sun | Evgeniy Gabrilovich |

StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling ACL IJCNLP

Yikang Shen | Yi Tay | Che Zheng | Dara Bahri | Donald Metzler | Aaron Courville |

How Reliable are Model Diagnostics? Findings

Vamsi Aribandi | Yi Tay | Donald Metzler |

Are Pretrained Convolutions Better than Pretrained Transformers? ACL IJCNLP

Yi Tay | Mostafa Dehghani | Jai Prakash Gupta | Vamsi Aribandi | Dara Bahri | Zhen Qin | Donald Metzler |

Reverse Engineering Configurations of Neural Text Generation Models ACL

Yi Tay | Dara Bahri | Che Zheng | Clifford Brunk | Donald Metzler | Andrew Tomkins |

Structured Event Retrieval over Microblog Archives NAACL

Donald Metzler | Congxing Cai | Eduard Hovy |

An Empirical Evaluation of Data-Driven Paraphrase Generation Techniques ACL

Donald Metzler | Eduard Hovy | Chunliang Zhang |

Contextual Bearing on Linguistic Variation in Social Media WS

Stephan Gouws | Donald Metzler | Congxing Cai | Eduard Hovy |

Unsupervised Mining of Lexical Variants from Noisy Text WS

Stephan Gouws | Dirk Hovy | Donald Metzler |

Search Engine Adaptation by Feedback Control Adjustment for Time-sensitive Query NAACL

Ruiqiang Zhang | Yi Chang | Zhaohui Zheng | Donald Metzler | Jian-yun Nie |