A reproduction study of methods for evaluating dialogue system output: Replicating Santhanam and Shaikh (2019) INLG

Anouck Braggaar | Frédéric Tomas | Peter Blomsma | Saar Hommes | Nadine Braun | Emiel van Miltenburg | Chris van der Lee | Martijn Goudbeek | Emiel Krahmer |

Preregistering NLP research NAACL

Emiel van Miltenburg | Chris van der Lee | Emiel Krahmer |

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ACL GEM IJCNLP

Sebastian Gehrmann | Tosin Adewumi | Karmanya Aggarwal | Pawan Sasanka Ammanamanchi | Anuoluwapo Aremu | Antoine Bosselut | Khyathi Raghavi Chandu | Miruna-Adriana Clinciu | Dipanjan Das | Kaustubh Dhole | Wanyu Du | Esin Durmus | Ondřej Dušek | Chris Chinenye Emezue | Varun Gangal | Cristina Garbacea | Tatsunori Hashimoto | Yufang Hou | Yacine Jernite | Harsh Jhamtani | Yangfeng Ji | Shailza Jolly | Mihir Kale | Dhruv Kumar | Faisal Ladhak | Aman Madaan | Mounica Maddela | Khyati Mahajan | Saad Mahamood | Bodhisattwa Prasad Majumder | Pedro Henrique Martins | Angelina McMillan-Major | Simon Mille | Emiel van Miltenburg | Moin Nadeem | Shashi Narayan | Vitaly Nikolaev | Andre Niyongabo Rubungo | Salomey Osei | Ankur Parikh | Laura Perez-Beltrachini | Niranjan Ramesh Rao | Vikas Raunak | Juan Diego Rodriguez | Sashank Santhanam | João Sedoc | Thibault Sellam | Samira Shaikh | Anastasia Shimorina | Marco Antonio Sobrevilla Cabezudo | Hendrik Strobelt | Nishant Subramani | Wei Xu | Diyi Yang | Akhila Yerukola | Jiawei Zhou |

Underreporting of errors in NLG output, and what to do about it INLG

Emiel van Miltenburg | Miruna Clinciu | Ondřej Dušek | Dimitra Gkatzia | Stephanie Inglis | Leo Leppänen | Saad Mahamood | Emma Manning | Stephanie Schoch | Craig Thomson | Luou Wen |

How Do Image Description Systems Describe People? A Targeted Assessment of System Competence in the PEOPLE-domain COLING LANTERN

Emiel van Miltenburg |

Gradations of Error Severity in Automatic Image Descriptions INLG

Emiel van Miltenburg | Wei-Ting Lu | Emiel Krahmer | Albert Gatt | Guanyi Chen | Lin Li | Kees van Deemter |

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions INLG

David M. Howcroft | Anya Belz | Miruna-Adriana Clinciu | Dimitra Gkatzia | Sadid A. Hasan | Saad Mahamood | Simon Mille | Emiel van Miltenburg | Sashank Santhanam | Verena Rieser |

Proceedings of the 1st Workshop on Evaluating NLG Evaluation EvalNLGEval INLG

Shubham Agarwal | Ondřej Dušek | Sebastian Gehrmann | Dimitra Gkatzia | Ioannis Konstas | Emiel Van Miltenburg | Sashank Santhanam |

Evaluation rules! On the use of grammars and rule-based systems for NLG evaluation EvalNLGEval INLG

Emiel van Miltenburg | Chris van der Lee | Thiago Castro-Ferreira | Emiel Krahmer |

Neural data-to-text generation: A comparison between pipeline and end-to-end architectures EMNLP

Thiago Castro Ferreira | Chris van der Lee | Emiel van Miltenburg | Emiel Krahmer |

Best practices for the human evaluation of automatically generated text INLG WS

Chris van der Lee | Albert Gatt | Emiel van Miltenburg | Sander Wubben | Emiel Krahmer |

On task effects in NLG corpus elicitation: a replication study using mixed effects modeling INLG WS

Emiel van Miltenburg | Merel van de Kerkhof | Ruud Koolen | Martijn Goudbeek | Emiel Krahmer |

Measuring the Diversity of Automatic Image Descriptions COLING

Emiel van Miltenburg | Desmond Elliott | Piek Vossen |

DIDEC: The Dutch Image Description and Eye-tracking Corpus COLING

Emiel van Miltenburg | Ákos Kádár | Ruud Koolen | Emiel Krahmer |

Varying image description tasks: spoken versus written descriptions COLING VarDial WS

Emiel van Miltenburg | Ruud Koolen | Emiel Krahmer |

Talking about other people: an endless range of possibilities INLG WS

Emiel van Miltenburg | Desmond Elliott | Piek Vossen |

Pragmatic descriptions of perceptual stimuli EACL

Emiel van Miltenburg |

Cross-linguistic differences and similarities in image descriptions INLG WS

Emiel van Miltenburg | Desmond Elliott | Piek Vossen |

The VU Sound Corpus: Adding More Fine-grained Annotations to the Freesound Database LREC

Emiel van Miltenburg | Benjamin Timmermans | Lora Aroyo |

Pragmatic Factors in Image Description: The Case of Negations WS

Emiel van Miltenburg | Roser Morante | Desmond Elliott |

Building a Dictionary of Affixal Negations EXprom WS

Chantal van Son | Emiel van Miltenburg | Roser Morante |

Open Dutch WordNet GWC

Marten Postma | Emiel van Miltenburg | Roxane Segers | Anneleen Schoen | Piek Vossen |

WordNet-based similarity metrics for adjectives GWC

Emiel van Miltenburg |

Sound-based distributional models IWCS WS

Alessandro Lopopolo | Emiel van Miltenburg |