NLPExplorer

GEM - 2023

Total Papers:- 33

Total Papers accross all years:- 96

Total Citations :- 0

1 2 3 »

Proceedings of the Third Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)

Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs

Xue-Yong Fu | Md Tahmid Rahman Laskar | Cheng Chen | Shashi Bhushan Tn |

Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses

Xenia Ohmer | Elia Bruni | Dieuwke Hupkes |

To Burst or Not to Burst: Generating and Quantifying Improbable Text

Kuleen Sasse | Efsun Sarioglu Kayi | Samuel Barham | Edward Staley |

Flesch or Fumble? Evaluating Readability Standard Alignment of Instruction-Tuned Language Models

Joseph Marvin Imperial | Harish Tayyar Madabushi |

Separating the Wheat from the Chaff with BREAD: An open-source benchmark and metrics to detect redundancy in text

Isaac Caswell | Lisa Wang | Isabel Papadimitriou |

Dialogue Quality and Emotion Annotations for Customer Support Conversations

RankAug: Augmented data ranking for text classification

Tiasa Roy | Priyam Basu |

How well ChatGPT understand Malaysian English? An Evaluation on Named Entity Recognition and Relation Extraction

Mohanraj Chanthran | Lay-Ki Soon | Ong Huey Fang | Bhawani Selvaretnam |

Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similarity

Predicting Question-Answering Performance of Large Language Models through Semantic Consistency

Towards Effective Long-Form QA with Evidence Augmentation

Mengxia Yu | Sara Rosenthal | Mihaela Bornea | Avi Sil |

Adapting Pre-trained Generative Models for Extractive Question Answering

Prabir Mallick | Tapas Nayak | Indrajit Bhattacharya |

Post Turing: Mapping the landscape of LLM Evaluation

Alexey Tikhonov | Ivan P. Yamshchikov |

ChatGPT as a Java Decompiler

Bradley Mcdanel | Zhanhao Liu |