iLab at SemEval-2023 Task 11 Le-Wi-Di: Modelling Disagreement or Modelling Perspectives? SemEval

Nikolas Vitsakis | Amit Parekh | Tanvi Dinkar | Gavin Abercrombie | Ioannis Konstas | Verena Rieser |

SemEval-2023 Task 11: Learning with Disagreements (LeWiDi) SemEval

Elisa Leonardelli | Gavin Abercrombie | Dina Almanea | Valerio Basile | Tommaso Fornaciari | Barbara Plank | Verena Rieser | Alexandra Uma | Massimo Poesio |

FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions SIGDIAL

Neeraj Cherakara | Finny Varghese | Sheena Shabana | Nivan Nelson | Abhiram Karukayil | Rohith Kulothungan | Mohammed Afil Farhan | Birthe Nesset | Meriam Moujahid | Tanvi Dinkar | Verena Rieser | Oliver Lemon |

Multitask Multimodal Prompted Training for Interactive Embodied Task Completion EMNLP

Georgios Pantazopoulos | Malvina Nikandrou | Amit Parekh | Bhathiya Hemanthage | Arash Eshghi | Ioannis Konstas | Verena Rieser | Oliver Lemon | Alessandro Suglia |

Adversarial Textual Robustness on Visual Dialog F i n d i n g s - A C L

Lu Yu | Verena Rieser |

evision PDF of 'Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP insights WS

Anya Belz | Craig Thomson | Ehud Reiter | Gavin Abercrombie | Jose M. Alonso-Moral | Mohammad Arvan | Anouck Braggaar | Mark Cieliebak | Elizabeth Clark | Kees van Deemter | Tanvi Dinkar | Ondřej Dušek | Steffen Eger | Qixiang Fang | Mingqi Gao | Albert Gatt | Dimitra Gkatzia | Javier González-Corbelle | Dirk Hovy | Manuela Hürlimann | Takumi Ito | John D. Kelleher | Filip Klubicka | Emiel Krahmer | Huiyuan Lai | Chris van der Lee | Yiru Li | Saad Mahamood | Margot Mieskes | Emiel van Miltenburg | Pablo Mosteiro | Malvina Nissim | Natalie Parde | Ondřej Plátek | Verena Rieser | Jie Ruan | Joel Tetreault | Antonio Toral | Xiaojun Wan | Leo Wanner | Lewis Watson | Diyi Yang |

The Dangers of trusting Stochastic Parrots: Faithfulness and Trust in Open-domain Conversational Question Answering F i n d i n g s - A C L

Sabrina Chiesurin | Dimitris Dimakopoulos | Marco Antonio Sobrevilla Cabezudo | Arash Eshghi | Ioannis Papaioannou | Verena Rieser | Ioannis Konstas |

Mirages. On Anthropomorphism in Dialogue Systems EMNLP

Gavin Abercrombie | Amanda Cercas Curry | Tanvi Dinkar | Verena Rieser | Zeerak Talat |

SafetyKit: First Aid for Measuring Safety in Open-domain Conversational Systems ACL

Emily Dinan | Gavin Abercrombie | A. Bergman | Shannon Spruit | Dirk Hovy | Y-Lan Boureau | Verena Rieser |

Proceedings of the 1st Workshop on Perspectivist Approaches to NLP @LREC2022 LREC NLPerspectives

Gavin Abercrombie | Valerio Basile | Sara Tonelli | Verena Rieser | Alexandra Uma |

Risk-graded Safety for Handling Medical Queries in Conversational AI AACL IJCNLP

Gavin Abercrombie | Verena Rieser |

Demonstrating EMMA: Embodied MultiModal Agent for Language-guided Action Execution in 3D Simulated Environments SIGDIAL

Alessandro Suglia | Bhathiya Hemanthage | Malvina Nikandrou | George Pantazopoulos | Amit Parekh | Arash Eshghi | Claudio Greco | Ioannis Konstas | Oliver Lemon | Verena Rieser |

Guiding the Release of Safer E2E Conversational AI through Value Sensitive Design SIGDIAL

A. Stevie Bergman | Gavin Abercrombie | Shannon Spruit | Dirk Hovy | Emily Dinan | Y-Lan Boureau | Verena Rieser |

OTTers: One-turn Topic Transitions for Open-Domain Dialogue ACL IJCNLP

Karin Sevegnani | David M. Howcroft | Ioannis Konstas | Verena Rieser |

MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization EMNLP Findings

Xinnuo Xu | Ondřej Dušek | Shashi Narayan | Verena Rieser | Ioannis Konstas |

AggGen: Ordering and Aggregating while Generating ACL IJCNLP

Xinnuo Xu | Ondřej Dušek | Verena Rieser | Ioannis Konstas |

What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think EMNLP

David M. Howcroft | Verena Rieser |

ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Abuse Detection in Conversational AI EMNLP

Amanda Cercas Curry | Gavin Abercrombie | Verena Rieser |

Alexa, Google, Siri: What are Your Pronouns? Gender and Anthropomorphism in the Design and Perception of Conversational Assistants ACL GeBNLP IJCNLP

Gavin Abercrombie | Amanda Cercas Curry | Mugdha Pandya | Verena Rieser |

Fact-based Content Weighting for Evaluating Abstractive Summarisation ACL

Xinnuo Xu | Ondřej Dušek | Jingyi Li | Verena Rieser | Ioannis Konstas |

History for Visual Dialog: Do we really need it? ACL

Shubham Agarwal | Trung Bui | Joon-Young Lee | Ioannis Konstas | Verena Rieser |

Conversational Assistants and Gender Stereotypes: Public Perceptions and Desiderata for Voice Personas COLING GeBNLP

Amanda Cercas Curry | Judy Robertson | Verena Rieser |

SLURP: A Spoken Language Understanding Resource Package EMNLP

Emanuele Bastianelli | Andrea Vanzo | Pawel Swietojanski | Verena Rieser |

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions INLG

David M. Howcroft | Anya Belz | Miruna-Adriana Clinciu | Dimitra Gkatzia | Sadid A. Hasan | Saad Mahamood | Simon Mille | Emiel van Miltenburg | Sashank Santhanam | Verena Rieser |

A Crowd-based Evaluation of Abuse Response Strategies in Conversational Agents WS

Amanda Cercas Curry | Verena Rieser |

User Evaluation of a Multi-dimensional Statistical Dialogue System WS

Simon Keizer | Ondřej Dušek | Xingkun Liu | Verena Rieser |

Automatic Quality Estimation for Natural Language Generation: Ranting (Jointly Rating and Ranking) INLG WS

Ondřej Dušek | Karin Sevegnani | Ioannis Konstas | Verena Rieser |

Semantic Noise Matters for Neural Natural Language Generation INLG WS

Ondřej Dušek | David M. Howcroft | Verena Rieser |

Better Conversations by Modeling, Filtering, and Optimizing for Coherence and Diversity EMNLP

Xinnuo Xu | Ondřej Dušek | Ioannis Konstas | Verena Rieser |

RankME: Reliable Human Ratings for Natural Language Generation NAACL

Jekaterina Novikova | Ondřej Dušek | Verena Rieser |

evision PDF of '#MeToo Alexa: How Conversational Systems Respond to Sexual Harassment Ethics-NLP NAACL WS

Amanda Cercas Curry | Verena Rieser |

A Knowledge-Grounded Multimodal Search-Based Conversational Agent EMNLP WS

Shubham Agarwal | Ondřej Dušek | Ioannis Konstas | Verena Rieser |

Improving Context Modelling in Multimodal Dialogue Generation INLG WS

Shubham Agarwal | Ondřej Dušek | Ioannis Konstas | Verena Rieser |

Findings of the E2E NLG Challenge INLG WS

Ondřej Dušek | Jekaterina Novikova | Verena Rieser |

Why We Need New Evaluation Metrics for NLG EMNLP

Jekaterina Novikova | Ondřej Dušek | Amanda Cercas Curry | Verena Rieser |

The E2E Dataset: New Challenges For End-to-End Generation SIGDIAL WS

Jekaterina Novikova | Ondřej Dušek | Verena Rieser |

The REAL Corpus: A Crowd-Sourced Corpus of Human Generated and Evaluated Spatial References to Real-World Urban Scenes LREC

Phil Bartie | William Mackaness | Dimitra Gkatzia | Verena Rieser |

Natural Language Generation enhances human decision-making with uncertain information ACL

Dimitra Gkatzia | Oliver Lemon | Verena Rieser |

iLab-Edinburgh at SemEval-2016 Task 7: A Hybrid Approach for Determining Sentiment Intensity of Arabic Twitter Phrases *SEMEVAL

Eshrag Refaee | Verena Rieser |

The aNALoGuE Challenge: Non Aligned Language GEneration INLG WS

Jekaterina Novikova | Verena Rieser |

Crowd-sourcing NLG Data: Pictures Elicit Better Data. INLG WS

Jekaterina Novikova | Oliver Lemon | Verena Rieser |

From the Virtual to the RealWorld: Referring to Objects in Real-World Spatial Scenes EMNLP

Dimitra Gkatzia | Verena Rieser | Phil Bartie | William Mackaness |

Benchmarking Machine Translated Sentiment Analysis for Arabic Tweets NAACL

Eshrag Refaee | Verena Rieser |

Generating and Evaluating Landmark-Based Navigation Instructions in Virtual Environments ENLG WS

Amanda Cercas Curry | Dimitra Gkatzia | Verena Rieser |

A Game-Based Setup for Data Collection and Task-Based Evaluation of Uncertain Information Presentation ENLG WS

Dimitra Gkatzia | Amanda Cercas Curry | Verena Rieser | Oliver Lemon |

Cluster-based Prediction of User Ratings for Stylistic Surface Realisation EACL

Nina Dethlefs | Heriberto Cuayáhuitl | Helen Hastie | Verena Rieser | Oliver Lemon |

An Arabic Twitter Corpus for Subjectivity and Sentiment Analysis LREC

Eshrag Refaee | Verena Rieser |

Evaluating Distant Supervision for Subjectivity and Sentiment Analysis on Arabic Twitter Feeds WANLP WS

Eshrag Refaee | Verena Rieser |

The PARLANCE mobile application for interactive search in English and Mandarin SIGDIAL WS

Helen Hastie | Marie-Aude Aufaure | Panos Alexopoulos | Hugues Bouchard | Catherine Breslin | Heriberto Cuayáhuitl | Nina Dethlefs | Milica Gašić | James Henderson | Oliver Lemon | Xingkun Liu | Peter Mika | Nesrine Ben Mustapha | Tim Potter | Verena Rieser | Blaise Thomson | Pirros Tsiakoulis | Yves Vanrompay | Boris Villazon-Terrazas | Majid Yazdani | Steve Young | Yanchao Yu |

Demonstration of the PARLANCE system: a data-driven incremental, spoken dialogue system for interactive search SIGDIAL WS

Helen Hastie | Marie-Aude Aufaure | Panos Alexopoulos | Heriberto Cuayáhuitl | Nina Dethlefs | Milica Gasic | James Henderson | Oliver Lemon | Xingkun Liu | Peter Mika | Nesrine Ben Mustapha | Verena Rieser | Blaise Thomson | Pirros Tsiakoulis | Yves Vanrompay |

Optimising Incremental Dialogue Decisions Using Information Density for Interactive Systems CoNLL EMNLP

Nina Dethlefs | Helen Hastie | Verena Rieser | Oliver Lemon |

Optimising Incremental Generation for Spoken Dialogue Systems: Reducing the Need for Fillers INLG WS

Nina Dethlefs | Helen Hastie | Verena Rieser | Oliver Lemon |

Learning and Evaluation of Dialogue Strategies for New Applications: Empirical Methods for Optimization from Small Data Sets CL

Verena Rieser | Oliver Lemon |

Adaptive Information Presentation for Spoken Dialogue Systems: Evaluation with real users ENLG WS

Verena Rieser | Simon Keizer | Oliver Lemon | Xingkun Liu |

Optimising Information Presentation for Spoken Dialogue Systems ACL

Verena Rieser | Oliver Lemon | Xingkun Liu |

Generation Under Uncertainty INLG WS

Oliver Lemon | Srini Janarthanam | Verena Rieser |

Natural Language Generation as Planning Under Uncertainty for Spoken Dialogue Systems EACL

Verena Rieser | Oliver Lemon |

Automatic Learning and Evaluation of User-Centered Objective Functions for Dialogue System Optimisation LREC

Verena Rieser | Oliver Lemon |

Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz Data: Bootstrapping and Evaluation ACL

Verena Rieser | Oliver Lemon |

The SAMMIE Corpus of Multimodal Dialogues with an MP3 Player LREC

Ivana Kruijff-Korbayová | Tilman Becker | Nate Blaylock | Ciprian Gerstenberger | Michael Kaißer | Peter Poller | Verena Rieser | Jan Schehl |

Using Machine Learning to Explore Human Multimodal Clarification Strategies ACL COLING

Verena Rieser | Oliver Lemon |

The SAMMIE Multimodal Dialogue Corpus Meets the Nite XML Toolkit WS

Ivana Kruijff-Korbayová | Verena Rieser | Ciprian Gerstenberger | Jan Schehl | Tilman Becker |

Implications for Generating Clarification Requests in Task-Oriented Dialogues ACL

Verena Rieser | Johanna Moore |

An Experiment Setup for Collecting Data for Adaptive Output Planning in a Multimodal Dialogue System ENLG WS

Ivana Kruijff-Korbayová | Nate Blaylock | Ciprian Gerstenberger | Verena Rieser | Tilman Becker | Michael Kaisser | Peter Poller | Jan Schehl |