Quantified Reproducibility Assessment of NLP Results ACL

Anya Belz | Maja Popovic | Simon Mille |

Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models Findings

Laura Pérez-Mayos | Alba Táboas García | Simon Mille | Leo Wanner |

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ACL GEM IJCNLP

Sebastian Gehrmann | Tosin Adewumi | Karmanya Aggarwal | Pawan Sasanka Ammanamanchi | Anuoluwapo Aremu | Antoine Bosselut | Khyathi Raghavi Chandu | Miruna-Adriana Clinciu | Dipanjan Das | Kaustubh Dhole | Wanyu Du | Esin Durmus | Ondřej Dušek | Chris Chinenye Emezue | Varun Gangal | Cristina Garbacea | Tatsunori Hashimoto | Yufang Hou | Yacine Jernite | Harsh Jhamtani | Yangfeng Ji | Shailza Jolly | Mihir Kale | Dhruv Kumar | Faisal Ladhak | Aman Madaan | Mounica Maddela | Khyati Mahajan | Saad Mahamood | Bodhisattwa Prasad Majumder | Pedro Henrique Martins | Angelina McMillan-Major | Simon Mille | Emiel van Miltenburg | Moin Nadeem | Shashi Narayan | Vitaly Nikolaev | Andre Niyongabo Rubungo | Salomey Osei | Ankur Parikh | Laura Perez-Beltrachini | Niranjan Ramesh Rao | Vikas Raunak | Juan Diego Rodriguez | Sashank Santhanam | João Sedoc | Thibault Sellam | Samira Shaikh | Anastasia Shimorina | Marco Antonio Sobrevilla Cabezudo | Hendrik Strobelt | Nishant Subramani | Wei Xu | Diyi Yang | Akhila Yerukola | Jiawei Zhou |

Proceedings of the Sixth International Conference on Dependency Linguistics (Depling, SyntaxFest 2021) DepLing SyntaxFest

Nicolas Mazziotta | Simon Mille |

Text-in-Context: Token-Level Error Detection for Table-to-Text Generation INLG

Zdeněk Kasner | Simon Mille | Ondřej Dušek |

Another PASS: A Reproduction Study of the Human Evaluation of a Football Report Generation System INLG

Simon Mille | Thiago Castro Ferreira | Anya Belz | Brian Davis |

The Third Multilingual Surface Realisation Shared Task (SR’20): Overview and Evaluation Results COLING MSR

Simon Mille | Anya Belz | Bernd Bohnet | Thiago Castro Ferreira | Yvette Graham | Leo Wanner |

Proceedings of the Third Workshop on Multilingual Surface Realisation COLING MSR

Anya Belz | Bernd Bohnet | Thiago Castro Ferreira | Yvette Graham | Simon Mille | Leo Wanner |

A General Benchmarking Framework for Text Generation INLG WebNLG

Diego Moussallem | Paramjot Kaur | Thiago Ferreira | Chris van der Lee | Anastasia Shimorina | Felix Conrads | Michael Röder | René Speck | Claire Gardent | Simon Mille | Nikolai Ilinykh | Axel-Cyrille Ngonga Ngomo |

Disentangling the Properties of Human Evaluation Methods: A Classification System to Support Comparability, Meta-Evaluation and Reproducibility Testing INLG

Anya Belz | Simon Mille | David M. Howcroft |

Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+) INLG WebNLG

Thiago Castro Ferreira | Claire Gardent | Nikolai Ilinykh | Chris van der Lee | Simon Mille | Diego Moussallem | Anastasia Shimorina |

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions INLG

David M. Howcroft | Anya Belz | Miruna-Adriana Clinciu | Dimitra Gkatzia | Sadid A. Hasan | Saad Mahamood | Simon Mille | Emiel van Miltenburg | Sashank Santhanam | Verena Rieser |

The 2020 Bilingual, Bi-Directional WebNLG+ Shared Task: Overview and Evaluation Results (WebNLG+ 2020) INLG WebNLG

Thiago Castro Ferreira | Claire Gardent | Nikolai Ilinykh | Chris van der Lee | Simon Mille | Diego Moussallem | Anastasia Shimorina |

A Case Study of NLG from Multimedia Data Sources: Generating Architectural Landmark Descriptions INLG WebNLG

Simon Mille | Petros Alvanitopoulos | Roberto Carlini Salguero | Jens Grivolla | Montserrat Marimon Felipe | Georgios Meditskos | Maria Rousi | Klearchos Stavrothanasopoulos | Spyridon Symeonidis | Stefanos Vrochidis | Leo Wanner |

Proceedings of the 2nd Workshop on Multilingual Surface Realisation (MSR 2019) EMNLP WS

Simon Mille | Anja Belz | Bernd Bohnet | Yvette Graham | Leo Wanner |

The Second Multilingual Surface Realisation Shared Task (SR’19): Overview and Evaluation Results EMNLP WS

Simon Mille | Anja Belz | Bernd Bohnet | Yvette Graham | Leo Wanner |

Back-Translation as Strategy to Tackle the Lack of Corpus in Natural Language Generation from Semantic Representations EMNLP WS

Marco Antonio Sobrevilla Cabezudo | Simon Mille | Thiago Pardo |

Teaching FORGe to Verbalize DBpedia Properties in Spanish INLG WS

Simon Mille | Stamatia Dasiopoulou | Beatriz Fisas | Leo Wanner |

Proceedings of the First Workshop on Multilingual Surface Realisation ACL WS

Simon Mille | Anja Belz | Bernd Bohnet | Emily Pitler | Leo Wanner |

evision PDF of 'The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results ACL WS

Simon Mille | Anja Belz | Bernd Bohnet | Yvette Graham | Emily Pitler | Leo Wanner |

Underspecified Universal Dependency Structures as Inputs for Multilingual Surface Realisation INLG WS

Simon Mille | Anja Belz | Bernd Bohnet | Leo Wanner |

Sentence Packaging in Text Generation from Semantic Graphs as a Community Detection Problem INLG WS

Alexander Shvets | Simon Mille | Leo Wanner |

FORGe at SemEval-2017 Task 9: Deep sentence generation based on a sequence of graph transducers *SEMEVAL

Simon Mille | Roberto Carlini | Alicia Burga | Leo Wanner |

Shared Task Proposal: Multilingual Surface Realization Using Universal Dependency Trees INLG WS

Simon Mille | Bernd Bohnet | Leo Wanner | Anja Belz |

A demo of FORGe: the Pompeu Fabra Open Rule-based Generator INLG WS

Simon Mille | Leo Wanner |

Data-driven sentence generation with non-isomorphic trees NAACL

Miguel Ballesteros | Bernd Bohnet | Simon Mille | Leo Wanner |

Visualizing Deep-Syntactic Parser Output NAACL

Juan Soler-Company | Miguel Ballesteros | Bernd Bohnet | Simon Mille | Leo Wanner |

Towards a multi-layered dependency annotation of Finnish DepLing WS

Alicia Burga | Simon Mille | Anton Granvik | Leo Wanner |

Deep-Syntactic Parsing COLING

Miguel Ballesteros | Bernd Bohnet | Simon Mille | Leo Wanner |

Classifiers for data-driven deep sentence generation INLG WS

Miguel Ballesteros | Simon Mille | Leo Wanner |

Exploring Morphosyntactic Annotation over a Spanish Corpus for Dependency Parsing DepLing WS

Miguel Ballesteros | Simon Mille | Alicia Burga |

AnCora-UPF: A Multi-Level Annotation of Spanish DepLing WS

Simon Mille | Alicia Burga | Leo Wanner |

How Does the Granularity of an Annotation Scheme Influence Dependency Parsing Performance? COLING

Simon Mille | Alicia Burga | Gabriela Ferraro | Leo Wanner |

Text Simplification Tools for Spanish LREC

Stefan Bott | Horacio Saggion | Simon Mille |

Towards a Surface Realization-Oriented Corpus Annotation INLG WS

Leo Wanner | Simon Mille | Bernd Bohnet |

The Surface Realisation Task: Recent Developments and Future Plans INLG WS

Anja Belz | Bernd Bohnet | Simon Mille | Leo Wanner | Michael White |

<StuMaBa>: From Deep Representation to Surface ENLG WS

Bernd Bohnet | Simon Mille | Benoît Favre | Leo Wanner |

Broad Coverage Multilingual Deep Sentence Generation with a Stochastic Multi-Level Realizer COLING

Bernd Bohnet | Leo Wanner | Simon Mille | Alicia Burga |

Syntactic Dependencies for Multilingual and Multilevel Corpus Annotation LREC

Simon Mille | Leo Wanner |

Making Text Resources Accessible to the Reader: the Case of Patent Claims LREC

Simon Mille | Leo Wanner |

Multilingual summarization in practice: the case of patent claims EAMT

Simon Mille | Leo Wanner |