ReproHum #0087-01: Human Evaluation Reproduction Report for Generating Fact Checking Explanations HumEval WS

Tyler Loakman | Chenghua Lin |

LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores F i n d i n g s - A C L

Yiqi Liu | Nafise Moosavi | Chenghua Lin |

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models F i n d i n g s - A C L

Yizhi Li | Ge Zhang | Xingwei Qu | Jiali Li | Zhaoqun Li | Noah Wang | Hao Li | Ruibin Yuan | Yinghao Ma | Kai Zhang | Wangchunshu Zhou | Yiming Liang | Lei Zhang | Lei Ma | Jiajun Zhang | Zuowen Li | Wenhao Huang | Chenghua Lin | Jie Fu |

SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation F i n d i n g s - A C L

Kun Zhao | Bohao Yang | Chen Tang | Chenghua Lin | Liang Zhan |

SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval F i n d i n g s - A C L

Siwei Wu | Yizhi Li | Kang Zhu | Ge Zhang | Yiming Liang | Kaijing Ma | Chenghao Xiao | Haoran Zhang | Bohao Yang | Wenhu Chen | Wenhao Huang | Noura Al Moubayed | Jie Fu | Chenghua Lin |

ATLAS: Improving Lay Summarisation with Attribute-based Control ACL

Zhihao Zhang | Tomas Goldsack | Carolina Scarton | Chenghua Lin |

ChatMusician: Understanding and Generating Music Intrinsically with LLM F i n d i n g s - A C L

Ruibin Yuan | Hanfeng Lin | Yi Wang | Zeyue Tian | Shangda Wu | Tianhao Shen | Ge Zhang | Yuhang Wu | Cong Liu | Ziya Zhou | Liumeng Xue | Ziyang Ma | Qin Liu | Tianyu Zheng | Yizhi Li | Yinghao Ma | Yiming Liang | Xiaowei Chi | Ruibo Liu | Zili Wang | Chenghua Lin | Qifeng Liu | Tao Jiang | Wenhao Huang | Wenhu Chen | Jie Fu | Emmanouil Benetos | Gus Xia | Roger Dannenberg | Wei Xue | Shiyin Kang | Yike Guo |

Overview of the BioLaySumm 2024 Shared Task on the Lay Summarization of Biomedical Research Articles BioNLP WS

Tomas Goldsack | Carolina Scarton | Matthew Shardlow | Chenghua Lin |

MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP

Shun Wang | Ge Zhang | Han Wu | Tyler Loakman | Wenhao Huang | Chenghua Lin |

Leveraging Estimated Transferability Over Human Intuition for Model Selection in Text Ranking EMNLP

Jun Bai | Zhuofan Chen | Zhenzi Li | Hanhua Hong | Jianfei Zhang | Chen Li | Chenghua Lin | Wenge Rong |

On the Rigour of Scientific Writing: Criteria, Analysis, and Insights F i n d i n g s - E M N L P

Joseph James | Chenghao Xiao | Yucheng Li | Chenghua Lin |

With Ears to See and Eyes to Hear: Sound Symbolism Experiments with Multimodal Large Language Models EMNLP

Tyler Loakman | Yucheng Li | Chenghua Lin |

An Open-Source Data Contamination Report for Large Language Models F i n d i n g s - E M N L P

Yucheng Li | Yunhao Guo | Frank Guerin | Chenghua Lin |