Quality and Quantity of Machine Translation References for Automatic Metrics HumEval WS

Vilém Zouhar | Ondřej Bojar |

Fine-Tuned Machine Translation Metrics Struggle in Unseen Domains ACL

Vilém Zouhar | Shuoyang Ding | Anna Currey | Tatyana Badeka | Jenyuan Wang | Brian Thompson |

How to Engage your Readers? Generating Guiding Questions to Promote Active Reading ACL

Peng Cui | Vilém Zouhar | Xiaoyu Zhang | Mrinmaya Sachan |

Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies ACL

Tom Kocmi | Vilém Zouhar | Christian Federmann | Matt Post |

Distributional Properties of Subword Regularization EMNLP

Marco Cognetta | Vilém Zouhar | Naoaki Okazaki |

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation WMT

Tom Kocmi | Vilém Zouhar | Eleftherios Avramidis | Roman Grundkiewicz | Marzena Karpinska | Maja Popović | Mrinmaya Sachan | Mariya Shmatova |

Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet WMT

Tom Kocmi | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Anton Dvorkovich | Christian Federmann | Mark Fishel | Markus Freitag | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Marzena Karpinska | Philipp Koehn | Benjamin Marie | Christof Monz | Kenton Murray | Masaaki Nagata | Martin Popel | Maja Popović | Mariya Shmatova | Steinthór Steingrímsson | Vilém Zouhar |

Pitfalls and Outlooks in Using COMET WMT

Vilém Zouhar | Pinzhen Chen | Tsz Kin Lam | Nikita Moghe | Barry Haddow |