Gender bias amplification during Speed-Quality optimization in Neural Machine Translation ACL IJCNLP

Adithya Renduchintala | Denise Diaz | Kenneth Heafield | Xian Li | Mona Diab |

TranslateLocally: Blazing-fast translation running on the local CPU EMNLP

Nikolay Bogoychev | Jelmer Van der Linde | Kenneth Heafield |

Findings of the WMT 2021 Shared Task on Efficient Translation EMNLP WMT

Kenneth Heafield | Qianqian Zhu | Roman Grundkiewicz |

Pruning Neural Machine Translation for Speed Using Group Lasso EMNLP WMT

Maximiliana Behnke | Kenneth Heafield |

The University of Edinburgh’s English-German and English-Hausa Submissions to the WMT21 News Translation Task EMNLP WMT

Pinzhen Chen | Jindřich Helcl | Ulrich Germann | Laurie Burchell | Nikolay Bogoychev | Antonio Valerio Miceli Barone | Jonas Waldendorf | Alexandra Birch | Kenneth Heafield |

Efficient Machine Translation with Model Pruning and Quantization EMNLP WMT

Maximiliana Behnke | Nikolay Bogoychev | Alham Fikri Aji | Kenneth Heafield | Graeme Nail | Qianqian Zhu | Svetlana Tchistiakova | Jelmer van der Linde | Pinzhen Chen | Sidharth Kashyap | Roman Grundkiewicz |

Findings of the 2021 Conference on Machine Translation (WMT21) EMNLP WMT

Farhad Akhbardeh | Arkady Arkhangorodsky | Magdalena Biesialska | Ondřej Bojar | Rajen Chatterjee | Vishrav Chaudhary | Marta R. Costa-jussa | Cristina España-Bonet | Angela Fan | Christian Federmann | Markus Freitag | Yvette Graham | Roman Grundkiewicz | Barry Haddow | Leonie Harter | Kenneth Heafield | Christopher Homan | Matthias Huck | Kwabena Amponsah-Kaakyire | Jungo Kasai | Daniel Khashabi | Kevin Knight | Tom Kocmi | Philipp Koehn | Nicholas Lourie | Christof Monz | Makoto Morishita | Masaaki Nagata | Ajay Nagesh | Toshiaki Nakazawa | Matteo Negri | Santanu Pal | Allahsera Auguste Tapo | Marco Turchi | Valentin Vydrin | Marcos Zampieri |

Edinburgh’s Submissions to the 2020 Machine Translation Efficiency Task ACL NGT WS

Nikolay Bogoychev | Roman Grundkiewicz | Alham Fikri Aji | Maximiliana Behnke | Kenneth Heafield | Sidharth Kashyap | Emmanouil-Ioannis Farsarakis | Mateusz Chudyk |

Findings of the Fourth Workshop on Neural Generation and Translation ACL NGT WS

Kenneth Heafield | Hiroaki Hayashi | Yusuke Oda | Ioannis Konstas | Andrew Finch | Graham Neubig | Xian Li | Alexandra Birch |

Parallel Sentence Mining by Constrained Decoding ACL

Pinzhen Chen | Nikolay Bogoychev | Kenneth Heafield | Faheem Kirefu |

Compressing Neural Machine Translation Models with 4-bit Precision ACL NGT WS

Alham Fikri Aji | Kenneth Heafield |

In Neural Machine Translation, What Does Transfer Learning Transfer? ACL

Alham Fikri Aji | Nikolay Bogoychev | Kenneth Heafield | Rico Sennrich |

Proceedings of the Fourth Workshop on Neural Generation and Translation ACL NGT WS

Alexandra Birch | Andrew Finch | Hiroaki Hayashi | Kenneth Heafield | Marcin Junczys-Dowmunt | Ioannis Konstas | Xian Li | Graham Neubig | Yusuke Oda |

ParaCrawl: Web-Scale Acquisition of Parallel Corpora ACL

Marta Bañón | Pinzhen Chen | Barry Haddow | Kenneth Heafield | Hieu Hoang | Miquel Esplà-Gomis | Mikel L. Forcada | Amir Kamran | Faheem Kirefu | Philipp Koehn | Sergio Ortiz Rojas | Leopoldo Pla Sempere | Gema Ramírez-Sánchez | Elsa Sarrías | Marek Strelec | Brian Thompson | William Waites | Dion Wiggins | Jaume Zaragoza |

Speed-optimized, Compact Student Models that Distill Knowledge from a Larger Teacher Model: the UEDIN-CUNI Submission to the WMT 2020 News Translation Task EMNLP WMT

Ulrich Germann | Roman Grundkiewicz | Martin Popel | Radina Dobreva | Nikolay Bogoychev | Kenneth Heafield |

Losing Heads in the Lottery: Pruning Transformer Attention in Neural Machine Translation EMNLP

Maximiliana Behnke | Kenneth Heafield |

The Sockeye 2 Neural Machine Translation Toolkit at AMTA 2020 AMTA

Tobias Domhan | Michael Denkowski | David Vilar | Xing Niu | Felix Hieber | Kenneth Heafield |

Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training EMNLP

Alham Fikri Aji | Kenneth Heafield | Nikolay Bogoychev |

Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP WS

Alham Fikri Aji | Kenneth Heafield |

Zero-Resource Neural Machine Translation with Monolingual Pivot Data EMNLP WS

Anna Currey | Kenneth Heafield |

From Research to Production and Back: Ludicrously Fast Neural Machine Translation EMNLP WS

Young Jin Kim | Marcin Junczys-Dowmunt | Hany Hassan | Alham Fikri Aji | Kenneth Heafield | Roman Grundkiewicz | Nikolay Bogoychev |

Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data ACL WS

Roman Grundkiewicz | Marcin Junczys-Dowmunt | Kenneth Heafield |

Incorporating Source Syntax into Transformer-Based Neural Machine Translation ACL WMT WS

Anna Currey | Kenneth Heafield |

Multi-Source Syntactic Neural Machine Translation EMNLP

Anna Currey | Kenneth Heafield |

Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation EMNLP

Nikolay Bogoychev | Kenneth Heafield | Alham Fikri Aji | Marcin Junczys-Dowmunt |

Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task NAACL

Marcin Junczys-Dowmunt | Roman Grundkiewicz | Shubha Guha | Kenneth Heafield |

Marian: Fast Neural Machine Translation in C++ ACL

Marcin Junczys-Dowmunt | Roman Grundkiewicz | Tomasz Dwojak | Hieu Hoang | Kenneth Heafield | Tom Neckermann | Frank Seide | Ulrich Germann | Alham Fikri Aji | Nikolay Bogoychev | André F. T. Martins | Alexandra Birch |

Neural Machine Translation Techniques for Named Entity Transliteration ACL WS

Roman Grundkiewicz | Kenneth Heafield |

Fast Neural Machine Translation Implementation ACL WS

Hieu Hoang | Tomasz Dwojak | Rihards Krislauks | Daniel Torregrosa | Kenneth Heafield |

Marian: Cost-effective High-Quality Neural Machine Translation in C++ ACL WS

Marcin Junczys-Dowmunt | Kenneth Heafield | Hieu Hoang | Roman Grundkiewicz | Anthony Aue |

Unsupervised Source Hierarchies for Low-Resource Neural Machine Translation ACL WS

Anna Currey | Kenneth Heafield |

The University of Edinburgh’s Submissions to the WMT18 News Translation Task EMNLP WMT WS

Barry Haddow | Nikolay Bogoychev | Denis Emelin | Ulrich Germann | Roman Grundkiewicz | Kenneth Heafield | Antonio Valerio Miceli Barone | Rico Sennrich |

Findings of the WMT 2018 Shared Task on Parallel Corpus Filtering EMNLP WMT WS

Philipp Koehn | Huda Khayrallah | Kenneth Heafield | Mikel L. Forcada |

Sparse Communication for Distributed Gradient Descent EMNLP

Alham Fikri Aji | Kenneth Heafield |

Copied Monolingual Data Improves Low-Resource Neural Machine Translation WMT WS

Anna Currey | Antonio Valerio Miceli Barone | Kenneth Heafield |

The University of Edinburgh’s Neural MT Systems for WMT17 WMT WS

Rico Sennrich | Alexandra Birch | Anna Currey | Ulrich Germann | Barry Haddow | Kenneth Heafield | Antonio Valerio Miceli Barone | Philip Williams |

Normalized Log-Linear Interpolation of Backoff Language Models is Efficient ACL

Kenneth Heafield | Chase Geigle | Sean Massung | Lane Schwartz |

Language Identification and Modeling in Specialized Hardware ACL IJCNLP

Kenneth Heafield | Rohan Kshirsagar | Santiago Barona |

N-gram Counts and Language Models from the Common Crawl LREC

Christian Buck | Kenneth Heafield | Bas van Ooyen |

Faster Phrase-Based Decoding by Refining Feature State ACL

Kenneth Heafield | Michael Kayser | Christopher D. Manning |

Edinburgh’s Phrase-based Machine Translation Systems for WMT-14 WMT WS

Nadir Durrani | Barry Haddow | Philipp Koehn | Kenneth Heafield |

Stanford University’s Submissions to the WMT 2014 Translation Task WMT WS

Julia Neidert | Sebastian Schuster | Spence Green | Kenneth Heafield | Christopher Manning |

Grouping Language Model Boundary Words to Speed K–Best Extraction from Hypergraphs NAACL

Kenneth Heafield | Philipp Koehn | Alon Lavie |

Scalable Modified Kneser-Ney Language Model Estimation ACL

Kenneth Heafield | Ivan Pouzyrevsky | Jonathan H. Clark | Philipp Koehn |

Edinburgh’s Machine Translation Systems for European Language Pairs WMT WS

Nadir Durrani | Barry Haddow | Kenneth Heafield | Philipp Koehn |

Language Model Rest Costs and Space-Efficient Storage CoNLL EMNLP

Kenneth Heafield | Philipp Koehn | Alon Lavie |

CMU System Combination in WMT 2011 WMT WS

Kenneth Heafield | Alon Lavie |

KenLM: Faster and Smaller Language Model Queries WMT WS

Kenneth Heafield |

Left language model state for syntactic machine translation IWSLT

Kenneth Heafield | Hieu Hoang | Philipp Koehn | Tetsuo Kiso | Marcello Federico |

CMU Multi-Engine Machine Translation for WMT 2010 WS

Kenneth Heafield | Alon Lavie |

Voting on N-grams for Machine Translation System Combination AMTA

Kenneth Heafield | Alon Lavie |

Machine Translation System Combination with Flexible Word Ordering WMT WS

Kenneth Heafield | Greg Hanneman | Alon Lavie |