CORE: Conflict-Oriented Reasoning for General Multimodal Manipulation Detection
Jinjie Shen ⋅ Yaxiong Wang ⋅ Yujiao Wu ⋅ Lechao Cheng ⋅ Tianrui Hui ⋅ Nan Pu ⋅ Zhihui Li ⋅ Zhun Zhong
Abstract
The rapid rise of generative AI has made multimodal fake news increasingly realistic and pervasive, posing severe threats to public trust and social stability. Existing detection methods rely heavily on manipulation-specific models and large-scale labeled data, resulting in poor generalization to emerging manipulation types. We observed that the essence of manipulated misinformation lies in its intrinsic conflicts, i.e., semantic or physical inconsistencies either across modalities or with common world knowledge. Inspired by this observation, we propose Conflict-{Oriented REasoning (CORE) framework, an effective paradigm that learns to endows multimodal large language models (MLLMs) with explicit conflict-capturing capability. To this end, CORE first constructs the Conflict Attribution Corpus (CAC) with fine-grained annotations of conflict factors and sources, providing essential data support for subsequent conflict perception training. By performing conflict-oriented representation enhancement and reasoning based on CAC, CORE achieves robust and generalizable conflict detection, effectively and rapidly adapting to unseen manipulation types with a few samples or in even zero-shot settings. Extensive experiments demonstrate that CORE surpasses state-of-the-art models by 9.7\%, 14.1\%, and 11.8\% in accuracy on the DGM$^4$, MMFakeBench, and MDSM benchmarks, respectively.
Lay Summary
Generative AI makes it increasingly easy to create realistic fake news that combines text, images, and videos, making misinformation harder to detect and more harmful to public trust. This paper introduces CORE, a framework that helps AI systems identify fake multimodal news by looking for conflicts within the content, such as mismatches between text and images or inconsistencies with common real-world knowledge. Instead of relying only on examples of known manipulations, CORE teaches models to understand why content may be suspicious. Experiments show that this approach improves detection across several benchmarks and generalizes better to new types of fake content, even with few or no training examples.
Successful Page Load