Symbol tuning improves in-context learning in language models EMNLP

Jerry Wei | Le Hou | Andrew Lampinen | Xiangning Chen | Da Huang | Yi Tay | Xinyun Chen | Yifeng Lu | Denny Zhou | Tengyu Ma | Quoc Le |

Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them F i n d i n g s - A C L

Mirac Suzgun | Nathan Scales | Nathanael Schärli | Sebastian Gehrmann | Yi Tay | Hyung Won Chung | Aakanksha Chowdhery | Quoc Le | Ed Chi | Denny Zhou | Jason Wei |

Inverse Scaling Can Become U-Shaped EMNLP

Jason Wei | Najoung Kim | Yi Tay | Quoc Le |

Transcending Scaling Laws with 0.1% Extra Compute EMNLP

Yi Tay | Jason Wei | Hyung Chung | Vinh Tran | David So | Siamak Shakeri | Xavier Garcia | Steven Zheng | Jinfeng Rao | Aakanksha Chowdhery | Denny Zhou | Donald Metzler | Slav Petrov | Neil Houlsby | Quoc Le | Mostafa Dehghani |

STraTA: Self-Training with Task Augmentation for Better Few-shot Learning EMNLP

Tu Vu | Minh-Thang Luong | Quoc Le | Grady Simon | Mohit Iyyer |

Pre-Training Transformers as Energy-Based Cloze Models EMNLP

Kevin Clark | Minh-Thang Luong | Quoc Le | Christopher D. Manning |

Transformer-XL: Attentive Language Models beyond a Fixed-Length Context ACL

Zihang Dai | Zhilin Yang | Yiming Yang | Jaime Carbonell | Quoc Le | Ruslan Salakhutdinov |

BAM! Born-Again Multi-Task Networks for Natural Language Understanding ACL

Kevin Clark | Minh-Thang Luong | Urvashi Khandelwal | Christopher D. Manning | Quoc V. Le |

Natural Questions: A Benchmark for Question Answering Research TACL

Tom Kwiatkowski | Jennimaria Palomaki | Olivia Redfield | Michael Collins | Ankur Parikh | Chris Alberti | Danielle Epstein | Illia Polosukhin | Jacob Devlin | Kenton Lee | Kristina Toutanova | Llion Jones | Matthew Kelcey | Ming-Wei Chang | Andrew M. Dai | Jakob Uszkoreit | Quoc Le | Slav Petrov |

Semi-Supervised Sequence Modeling with Cross-View Training EMNLP

Kevin Clark | Minh-Thang Luong | Christopher D. Manning | Quoc Le |

AirDialogue: An Environment for Goal-Oriented Dialogue Research EMNLP

Wei Wei | Quoc Le | Andrew Dai | Jia Li |

Unsupervised Pretraining for Sequence to Sequence Learning EMNLP

Prajit Ramachandran | Peter Liu | Quoc Le |

Massive Exploration of Neural Machine Translation Architectures EMNLP

Denny Britz | Anna Goldie | Minh-Thang Luong | Quoc Le |

Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision ACL

Chen Liang | Jonathan Berant | Quoc Le | Kenneth D. Forbus | Ni Lao |

Learning to Skim Text ACL

Adams Wei Yu | Hongrae Lee | Quoc Le |

Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation TACL

Melvin Johnson | Mike Schuster | Quoc V. Le | Maxim Krikun | Yonghui Wu | Zhifeng Chen | Nikhil Thorat | Fernanda Viégas | Martin Wattenberg | Greg Corrado | Macduff Hughes | Jeffrey Dean |

Effective Domain Mixing for Neural Machine Translation WMT WS

Denny Britz | Quoc Le | Reid Pryzant |

Addressing the Rare Word Problem in Neural Machine Translation ACL IJCNLP

Thang Luong | Ilya Sutskever | Quoc Le | Oriol Vinyals | Wojciech Zaremba |

Grounded Compositional Semantics for Finding and Describing Images with Sentences TACL

Richard Socher | Andrej Karpathy | Quoc V. Le | Christopher D. Manning | Andrew Y. Ng |