Evaluating Metrics for Document-context Evaluation in Machine Translation WMT

Vikas Raunak | Tom Kocmi | Matt Post |

Leveraging GPT-4 for Automatic Translation Post-Editing F i n d i n g s - E M N L P

Vikas Raunak | Amr Sharaf | Yiren Wang | Hany Awadalla | Arul Menezes |

Dissecting In-Context Learning of Translations in GPT-3 F i n d i n g s - E M N L P

Vikas Raunak | Arul Menezes | Hany Awadalla |

Do GPTs Produce Less Literal Translations? ACL

Vikas Raunak | Arul Menezes | Matt Post | Hany Hassan |

SALTED: A Framework for SAlient Long-tail Translation Error Detection F i n d i n g s - E M N L P

Vikas Raunak | Matt Post | Arul Menezes |

Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks F i n d i n g s - E M N L P

Vikas Raunak | Arul Menezes |

Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks NAACL

Siddharth Dalmia | Brian Yan | Vikas Raunak | Florian Metze | Shinji Watanabe |

The Curious Case of Hallucinations in Neural Machine Translation NAACL

Vikas Raunak | Arul Menezes | Marcin Junczys-Dowmunt |

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ACL GEM IJCNLP

Sebastian Gehrmann | Tosin Adewumi | Karmanya Aggarwal | Pawan Sasanka Ammanamanchi | Anuoluwapo Aremu | Antoine Bosselut | Khyathi Raghavi Chandu | Miruna-Adriana Clinciu | Dipanjan Das | Kaustubh Dhole | Wanyu Du | Esin Durmus | Ondřej Dušek | Chris Chinenye Emezue | Varun Gangal | Cristina Garbacea | Tatsunori Hashimoto | Yufang Hou | Yacine Jernite | Harsh Jhamtani | Yangfeng Ji | Shailza Jolly | Mihir Kale | Dhruv Kumar | Faisal Ladhak | Aman Madaan | Mounica Maddela | Khyati Mahajan | Saad Mahamood | Bodhisattwa Prasad Majumder | Pedro Henrique Martins | Angelina McMillan-Major | Simon Mille | Emiel van Miltenburg | Moin Nadeem | Shashi Narayan | Vitaly Nikolaev | Andre Niyongabo Rubungo | Salomey Osei | Ankur Parikh | Laura Perez-Beltrachini | Niranjan Ramesh Rao | Vikas Raunak | Juan Diego Rodriguez | Sashank Santhanam | João Sedoc | Thibault Sellam | Samira Shaikh | Anastasia Shimorina | Marco Antonio Sobrevilla Cabezudo | Hendrik Strobelt | Nishant Subramani | Wei Xu | Diyi Yang | Akhila Yerukola | Jiawei Zhou |

On Dimensional Linguistic Properties of the Word Embedding Space ACL RepL4NLP WS

Vikas Raunak | Vaibhav Kumar | Vivek Gupta | Florian Metze |

On Long-Tailed Phenomena in Neural Machine Translation EMNLP Findings

Vikas Raunak | Siddharth Dalmia | Vivek Gupta | Florian Metze |

Effective Dimensionality Reduction for Word Embeddings ACL WS

Vikas Raunak | Vivek Gupta | Florian Metze |

On Leveraging the Visual Modality for Neural Machine Translation INLG WS

Vikas Raunak | Sang Keun Choe | Quanyang Lu | Yi Xu | Florian Metze |