Learning from Children: Improving Image-Caption Pretraining via Curriculum F i n d i n g s - A C L

Hammad Ayyubi | Rahul Lokesh | Alireza Zareian | Bo Wu | Shih-Fu Chang |

Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyond F i n d i n g s - E M N L P

Zhecan Wang | Long Chen | Haoxuan You | Keyang Xu | Yicheng He | Wenhao Li | Noel Codella | Kai-Wei Chang | Shih-Fu Chang |

IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Models F i n d i n g s - E M N L P

Haoxuan You | Rui Sun | Zhecan Wang | Long Chen | Gengyu Wang | Hammad Ayyubi | Kai-Wei Chang | Shih-Fu Chang |

Enhanced Chart Understanding via Visual Language Pre-training on Plot Table Pairs F i n d i n g s - A C L

Mingyang Zhou | Yi Fung | Long Chen | Christopher Thomas | Heng Ji | Shih-Fu Chang |

UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding F i n d i n g s - A C L

Rui Sun | Zhecan Wang | Haoxuan You | Noel Codella | Kai-Wei Chang | Shih-Fu Chang |

Non-Sequential Graph Script Induction via Multimedia Grounding ACL

Yu Zhou | Sha Li | Manling Li | Xudong Lin | Shih-Fu Chang | Mohit Bansal | Heng Ji |

Bridging the Gap between Recognition-level Pre-training and Commonsensical Vision-language Tasks ACL CSRR

Yue Wan | Yueen Ma | Haoxuan You | Zhecan Wang | Shih-Fu Chang |

RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios NAACL

Xinya Du | Zixuan Zhang | Sha Li | Pengfei Yu | Hongwei Wang | Tuan Lai | Xudong Lin | Ziqi Wang | Iris Liu | Ben Zhou | Haoyang Wen | Manling Li | Darryl Hannan | Jie Lei | Hyounghun Kim | Rotem Dror | Haoyu Wang | Michael Regan | Qi Zeng | Qing Lyu | Charles Yu | Carl Edwards | Xiaomeng Jin | Yizhu Jiao | Ghazaleh Kazeminejad | Zhenhailong Wang | Chris Callison-Burch | Mohit Bansal | Carl Vondrick | Jiawei Han | Dan Roth | Shih-Fu Chang | Martha Palmer | Heng Ji |

Find Someone Who: Visual Commonsense Understanding in Human-Centric Grounding F i n d i n g s - E M N L P

Haoxuan You | Rui Sun | Zhecan Wang | Kai-Wei Chang | Shih-Fu Chang |

Weakly-Supervised Temporal Article Grounding EMNLP

Long Chen | Yulei Niu | Brian Chen | Xudong Lin | Guangxing Han | Christopher Thomas | Hammad Ayyubi | Heng Ji | Shih-Fu Chang |

Understanding ME? Multimodal Evaluation for Fine-grained Visual Commonsense EMNLP

Zhecan Wang | Haoxuan You | Yicheng He | Wenhao Li | Kai-Wei Chang | Shih-Fu Chang |

COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation NAACL

Qingyun Wang | Manling Li | Xuan Wang | Nikolaus Parulian | Guangxing Han | Jiawei Ma | Jingxuan Tu | Ying Lin | Ranran Haoran Zhang | Weili Liu | Aabhas Chauhan | Yingjun Guan | Bangzheng Li | Ruisong Li | Xiangchen Song | Yi Fung | Heng Ji | Jiawei Han | Shih-Fu Chang | James Pustejovsky | Jasmine Rah | David Liem | Ahmed ELsayed | Martha Palmer | Clare Voss | Cynthia Schneider | Boyan Onyshkevych |

RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System NAACL

Haoyang Wen | Ying Lin | Tuan Lai | Xiaoman Pan | Sha Li | Xudong Lin | Ben Zhou | Manling Li | Haoyu Wang | Hongming Zhang | Xiaodong Yu | Alexander Dong | Zhenhailong Wang | Yi Fung | Piyush Mishra | Qing Lyu | Dídac Surís | Brian Chen | Susan Windisch Brown | Martha Palmer | Chris Callison-Burch | Carl Vondrick | Jiawei Han | Dan Roth | Shih-Fu Chang | Heng Ji |

Unsupervised Vision-and-Language Pre-training Without Parallel Images and Captions NAACL

Liunian Harold Li | Haoxuan You | Zhecan Wang | Alireza Zareian | Shih-Fu Chang | Kai-Wei Chang |

InfoSurgeon: Cross-Media Fine-grained Information Consistency Checking for Fake News Detection ACL IJCNLP

Yi Fung | Christopher Thomas | Revanth Gangi Reddy | Sandeep Polisetty | Heng Ji | Shih-Fu Chang | Kathleen McKeown | Mohit Bansal | Avi Sil |

Joint Multimedia Event Extraction from Video and Article EMNLP Findings

Brian Chen | Xudong Lin | Christopher Thomas | Manling Li | Shoya Yoshida | Lovish Chum | Heng Ji | Shih-Fu Chang |

Coreference by Appearance: Visually Grounded Event Coreference Resolution CRAC EMNLP

Liming Wang | Shengyu Feng | Xudong Lin | Manling Li | Heng Ji | Shih-Fu Chang |

Cross-media Structured Common Space for Multimedia Event Extraction ACL

Manling Li | Alireza Zareian | Qi Zeng | Spencer Whitehead | Di Lu | Heng Ji | Shih-Fu Chang |

GAIA: A Fine-grained Multimedia Knowledge Extraction System ACL

Manling Li | Alireza Zareian | Ying Lin | Xiaoman Pan | Spencer Whitehead | Brian Chen | Bo Wu | Heng Ji | Shih-Fu Chang | Clare Voss | Daniel Napierski | Marjorie Freedman |

Cross-lingual Structure Transfer for Zero-resource Event Extraction LREC

Di Lu | Ananya Subburathinam | Heng Ji | Jonathan May | Shih-Fu Chang | Avi Sil | Clare Voss |

Cross-lingual Structure Transfer for Relation and Event Extraction EMNLP

Ananya Subburathinam | Di Lu | Heng Ji | Jonathan May | Shih-Fu Chang | Avirup Sil | Clare Voss |

Incorporating Background Knowledge into Video Description Generation EMNLP

Spencer Whitehead | Heng Ji | Mohit Bansal | Shih-Fu Chang | Clare Voss |

Entity-aware Image Caption Generation EMNLP

Di Lu | Spencer Whitehead | Lifu Huang | Heng Ji | Shih-Fu Chang |

Cross-media Event Extraction and Recommendation NAACL

Di Lu | Clare Voss | Fangbo Tao | Xiang Ren | Rachel Guan | Rostyslav Korolov | Tongtao Zhang | Dongang Wang | Hongzhi Li | Taylor Cassidy | Heng Ji | Shih-fu Chang | Jiawei Han | William Wallace | James Hendler | Mei Si | Lance Kaplan |

A Multi-media Approach to Cross-lingual Entity Knowledge Transfer ACL

Di Lu | Xiaoman Pan | Nima Pourdamghani | Shih-Fu Chang | Heng Ji | Kevin Knight |

Cross-document Event Coreference Resolution based on Cross-media Features EMNLP

Tongtao Zhang | Hongzhi Li | Heng Ji | Shih-Fu Chang |

Exploring Text and Image Features to Classify Images in Bioscience Literature WS

Barry Rafkind | Minsuk Lee | Shih-Fu Chang | Hong Yu |