Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models F i n d i n g s - A C L

Yihong Dong | Xue Jiang | Huanyu Liu | Zhi Jin | Bin Gu | Mengfei Yang | Ge Li |

DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories F i n d i n g s - A C L

Jia Li | Ge Li | Yunfei Zhao | Yongmin Li | Huanyu Liu | Hao Zhu | Lecheng Wang | Kaibo Liu | Zheng Fang | Lanshen Wang | Jiazheng Ding | Xuanming Zhang | Yuqi Zhu | Yihong Dong | Zhi Jin | Binhua Li | Fei Huang | Yongbin Li | Bin Gu | Mengfei Yang |