On Evaluating the Integration of Reasoning and Action in LLM Agents with Database Question Answering F i n d i n g s - N A A C L

Linyong Nan | Ellen Zhang | Weijin Zou | Yilun Zhao | Wenfei Zhou | Arman Cohan |

Struc-Bench: Are Large Language Models Good at Generating Complex Structured Tabular Data? NAACL

Xiangru Tang | Yiming Zong | Jason Phang | Yilun Zhao | Wangchunshu Zhou | Arman Cohan | Mark Gerstein |

Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization F i n d i n g s - N A A C L

Yixin Liu | Alexander Fabbri | Jiawen Chen | Yilun Zhao | Simeng Han | Shafiq Joty | Pengfei Liu | Dragomir Radev | Chien-Sheng Wu | Arman Cohan |

Unveiling the Spectrum of Data Contamination in Language Model: A Survey from Detection to Remediation F i n d i n g s - A C L

Chunyuan Deng | Yilun Zhao | Yuzhao Heng | Yitong Li | Jiannan Cao | Xiangru Tang | Arman Cohan |

KnowledgeFMath: A Knowledge-Intensive Math Reasoning Dataset in Finance Domains ACL

Yilun Zhao | Hongjun Liu | Yitao Long | Rui Zhang | Chen Zhao | Arman Cohan |

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning F i n d i n g s - A C L

Xiangru Tang | Anni Zou | Zhuosheng Zhang | Ziming Li | Yilun Zhao | Xingyao Zhang | Arman Cohan | Mark Gerstein |

Investigating Data Contamination in Modern Benchmarks for Large Language Models NAACL

Chunyuan Deng | Yilun Zhao | Xiangru Tang | Mark Gerstein | Arman Cohan |

TaPERA: Enhancing Faithfulness and Interpretability in Long-Form Table QA by Content Planning and Execution-based Reasoning ACL

Yilun Zhao | Lyuhao Chen | Arman Cohan | Chen Zhao |

DocMath-Eval: Evaluating Math Reasoning Capabilities of LLMs in Understanding Financial Documents ACL

Yilun Zhao | Yitao Long | Hongjun Liu | Ryo Kamoi | Linyong Nan | Lyuhao Chen | Yixin Liu | Xiangru Tang | Rui Zhang | Arman Cohan |

L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language Models TACL

Ansong Ni | Pengcheng Yin | Yilun Zhao | Martin Riddell | Troy Feng | Rui Shen | Stephen Yin | Ye Liu | Semih Yavuz | Caiming Xiong | Shafiq Joty | Yingbo Zhou | Dragomir Radev | Arman Cohan | Arman Cohan |

Revisiting Automated Evaluation for Long-form Table Question Answering EMNLP

Yuqi Wang | Lyuhao Chen | Songcheng Cai | Zhijian Xu | Yilun Zhao |

FOLIO: Natural Language Reasoning with First-Order Logic EMNLP

Simeng Han | Hailey Schoelkopf | Yilun Zhao | Zhenting Qi | Martin Riddell | Wenfei Zhou | James Coady | David Peng | Yujie Qiao | Luke Benson | Lucy Sun | Alexander Wardle-Solano | Hannah Szabó | Ekaterina Zubova | Matthew Burtell | Jonathan Fan | Yixin Liu | Brian Wong | Malcolm Sailor | Ansong Ni | Linyong Nan | Jungo Kasai | Tao Yu | Rui Zhang | Alexander Fabbri | Wojciech Maciej Kryscinski | Semih Yavuz | Ye Liu | Xi Victoria Lin | Shafiq Joty | Yingbo Zhou | Caiming Xiong | Rex Ying | Arman Cohan | Dragomir Radev |

OpenT2T: An Open-Source Toolkit for Table-to-Text Generation EMNLP

Haowei Zhang | Shengyun Si | Yilun Zhao | Lujing Xie | Zhijian Xu | Lyuhao Chen | Linyong Nan | Pengcheng Wang | Xiangru Tang | Arman Cohan |

MIMIR: A Customizable Agent Tuning Platform for Enhanced Scientific Applications EMNLP

Xiangru Tang | Chunyuan Deng | Hanminwang Hanminwang | Haoran Wang | Yilun Zhao | Wenqi Shi | Yi Fung | Wangchunshu Zhou | Jiannan Cao | Heng Ji | Arman Cohan | Mark Gerstein |

TAIL: A Toolkit for Automatic and Realistic Long-Context Large Language Model Evaluation EMNLP

Gefei Gu | Yilun Zhao | Ruoxi Ning | Yanan Zheng | Arman Cohan |

FinDVer: Explainable Claim Verification over Long and Hybrid-content Financial Documents EMNLP

Yilun Zhao | Yitao Long | Tintin Jiang | Chengye Wang | Weiyuan Chen | Hongjun Liu | Xiangru Tang | Yiming Zhang | Chen Zhao | Arman Cohan |

OMG-QA: Building Open-Domain Multi-Modal Generative Question Answering Systems EMNLP

Linyong Nan | Weining Fang | Aylin Rasteh | Pouya Lahabi | Weijin Zou | Yilun Zhao | Arman Cohan |

M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models F i n d i n g s - E M N L P

Chuhan Li | Ziyao Shangguan | Yilun Zhao | Deyuan Li | Yixin Liu | Arman Cohan |

P-FOLIO: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains F i n d i n g s - E M N L P

Simeng Han | Aaron Yu | Rui Shen | Zhenting Qi | Martin Riddell | Wenfei Zhou | Yujie Qiao | Yilun Zhao | Semih Yavuz | Ye Liu | Shafiq Joty | Yingbo Zhou | Caiming Xiong | Dragomir Radev | Rex Ying | Arman Cohan |