ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution F i n d i n g s - A C L

Xuanming Zhang | Zixun Chen | Zhou Yu |

DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories F i n d i n g s - A C L

Jia Li | Ge Li | Yunfei Zhao | Yongmin Li | Huanyu Liu | Hao Zhu | Lecheng Wang | Kaibo Liu | Zheng Fang | Lanshen Wang | Jiazheng Ding | Xuanming Zhang | Yuqi Zhu | Yihong Dong | Zhi Jin | Binhua Li | Fei Huang | Yongbin Li | Bin Gu | Mengfei Yang |

DECOR: Improving Coherence in L2 English Writing with a Novel Benchmark for Incoherence Detection, Reasoning, and Rewriting EMNLP

Xuanming Zhang | Anthony Diaz | Zixun Chen | Qingyang Wu | Kun Qian | Erik Voss | Zhou Yu |

VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation F i n d i n g s - E M N L P

Kun Qian | Shunji Wan | Claudia Tang | Youzhi Wang | Xuanming Zhang | Maximillian Chen | Zhou Yu |