NLPExplorer

Yi Tay

Number of Papers:- 32

Number of Citations:- 8

First ACL Paper:- 2016

Latest ACL Paper:- 2023

Venues:-

s

EMNLP

i

d

NAACL

-

A

Findings

L

P

IJCNLP

ACL

E

C

M

N

F

n

g

Co-Authors:-

Aakanksha Chowdhery

Aaron Courville

Similar Authors:-

Stanley Jungkyu Choi

Chidori Nakamura

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? F i n d i n g s - E M N L P

Yi Tay | Mostafa Dehghani | Samira Abnar | Hyung Chung | William Fedus | Jinfeng Rao | Sharan Narang | Vinh Tran | Dani Yogatama | Donald Metzler |

Symbol tuning improves in-context learning in language models EMNLP

Jerry Wei | Le Hou | Andrew Lampinen | Xiangning Chen | Da Huang | Yi Tay | Xinyun Chen | Yifeng Lu | Denny Zhou | Tengyu Ma | Quoc Le |

Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them F i n d i n g s - A C L

Mirac Suzgun | Nathan Scales | Nathanael Schärli | Sebastian Gehrmann | Yi Tay | Hyung Won Chung | Aakanksha Chowdhery | Quoc Le | Ed Chi | Denny Zhou | Jason Wei |

CoLT5: Faster Long-Range Transformers with Conditional Computation EMNLP

Joshua Ainslie | Tao Lei | Michiel de Jong | Santiago Ontanon | Siddhartha Brahma | Yury Zemlyanskiy | David Uthus | Mandy Guo | James Lee-Thorp | Yi Tay | Yun-Hsuan Sung | Sumit Sanghai |

Inverse Scaling Can Become U-Shaped EMNLP

Jason Wei | Najoung Kim | Yi Tay | Quoc Le |

DSI++: Updating Transformer Memory with New Documents EMNLP

Sanket Vaibhav Mehta | Jai Gupta | Yi Tay | Mostafa Dehghani | Vinh Q. Tran | Jinfeng Rao | Marc Najork | Emma Strubell | Donald Metzler |

Transcending Scaling Laws with 0.1% Extra Compute EMNLP

Yi Tay | Jason Wei | Hyung Chung | Vinh Tran | David So | Siamak Shakeri | Xavier Garcia | Steven Zheng | Jinfeng Rao | Aakanksha Chowdhery | Denny Zhou | Donald Metzler | Slav Petrov | Neil Houlsby | Quoc Le | Mostafa Dehghani |

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference ACL Findings

Kai Hui | Honglei Zhuang | Tao Chen | Zhen Qin | Jing Lu | Dara Bahri | Ji Ma | Jai Gupta | Cicero Nogueira dos Santos | Yi Tay | Donald Metzler |

Sharpness-Aware Minimization Improves Language Model Generalization ACL

Dara Bahri | Hossein Mobahi | Yi Tay |

Improving Compositional Generalization with Self-Training for Data-to-Text Generation ACL

Sanket Vaibhav Mehta | Jinfeng Rao | Yi Tay | Mihir Kale | Ankur Parikh | Emma Strubell |

Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification EMNLP

Jai Gupta | Yi Tay | Chaitanya Kamath | Vinh Tran | Donald Metzler | Shailesh Bavadekar | Mimi Sun | Evgeniy Gabrilovich |

Knowledge Router: Learning Disentangled Representations for Knowledge Graphs NAACL

Shuai Zhang | Xi Rao | Yi Tay | Ce Zhang |

StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling ACL IJCNLP

Yikang Shen | Yi Tay | Che Zheng | Dara Bahri | Donald Metzler | Aaron Courville |

Do Transformer Modifications Transfer Across Implementations and Applications? EMNLP

Sharan Narang | Hyung Won Chung | Yi Tay | Liam Fedus | Thibault Fevry | Michael Matena | Karishma Malkan | Noah Fiedel | Noam Shazeer | Zhenzhong Lan | Yanqi Zhou | Wei Li | Nan Ding | Jake Marcus | Adam Roberts | Colin Raffel |

How Reliable are Model Diagnostics? Findings

Vamsi Aribandi | Yi Tay | Donald Metzler |

On Orthogonality Constraints for Transformers ACL IJCNLP

Aston Zhang | Alvin Chan | Yi Tay | Jie Fu | Shuohang Wang | Shuai Zhang | Huajie Shao | Shuochao Yao | Roy Ka-Wei Lee |

Are Pretrained Convolutions Better than Pretrained Transformers? ACL IJCNLP

Yi Tay | Mostafa Dehghani | Jai Prakash Gupta | Vamsi Aribandi | Dara Bahri | Zhen Qin | Donald Metzler |

Interactive Machine Comprehension with Information Seeking Agents ACL

Xingdi Yuan | Jie Fu | Marc-Alexandre Côté | Yi Tay | Chris Pal | Adam Trischler |

Would you Rather? A New Benchmark for Learning Machine Alignment with Cultural Values and Social Preferences ACL

Yi Tay | Donovan Ong | Jie Fu | Alvin Chan | Nancy Chen | Anh Tuan Luu | Chris Pal |

Reverse Engineering Configurations of Neural Text Generation Models ACL

Yi Tay | Dara Bahri | Che Zheng | Clifford Brunk | Donald Metzler | Andrew Tomkins |

Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder EMNLP Findings

Alvin Chan | Yi Tay | Yew-Soon Ong | Aston Zhang |

Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling EMNLP

Jinfeng Rao | Linqing Liu | Yi Tay | Wei Yang | Peng Shi | Jimmy Lin |

Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks ACL

Yi Tay | Aston Zhang | Anh Tuan Luu | Jinfeng Rao | Shuai Zhang | Shuohang Wang | Jie Fu | Siu Cheung Hui |

Robust Representation Learning of Biomedical Names ACL

Minh C. Phan | Aixin Sun | Yi Tay |

Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives ACL

Yi Tay | Shuohang Wang | Anh Tuan Luu | Jie Fu | Minh C. Phan | Xingdi Yuan | Jinfeng Rao | Siu Cheung Hui | Aston Zhang |

Confusionset-guided Pointer Networks for Chinese Spelling Check ACL

Dingmin Wang | Yi Tay | Li Zhong |

Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inference EMNLP

Yi Tay | Anh Tuan Luu | Siu Cheung Hui |

Multi-Granular Sequence Encoding via Dilated Compositional Units for Reading Comprehension EMNLP

Yi Tay | Anh Tuan Luu | Siu Cheung Hui |

Attentive Gated Lexicon Reader with Contrastive Contextual Co-Attention for Sentiment Classification EMNLP

Yi Tay | Anh Tuan Luu | Siu Cheung Hui | Jian Su |

Co-Stack Residual Affinity Networks with Multi-level Attention Refinement for Matching Text Sequences EMNLP

Yi Tay | Anh Tuan Luu | Siu Cheung Hui |

Reasoning with Sarcasm by Reading In-Between ACL

Yi Tay | Anh Tuan Luu | Siu Cheung Hui | Jian Su |

Learning Term Embeddings for Taxonomic Relation Identification Using Dynamic Weighting Neural Network EMNLP

Anh Tuan Luu | Yi Tay | Siu Cheung Hui | See Kiong Ng |

.