# Multimodal Claim Extraction for Fact-Checking

Source: [Multimodal Claim Extraction for Fact-Checking](<https://www.sota2.com/research/paper/69e704827d0172140ec7ec10>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-22T05:21:28.943Z

Authors: Joycelyn Teo, Rui Cao, Zhenyun Deng, Zifeng Ding, Michael Sejr Schlichtkrull, Andreas Vlachos

Published: 2026-02-01T05:21:15.000Z

## Abstract

Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinformation. Social media posts often combine short, informal text with images such as memes, screenshots, and photos, creating challenges that differ from both text-only claim extraction and well-studied multimodal tasks like image captioning or visual question answering. In this work, we present the first benchmark for multimodal claim extraction from social media, consisting of posts containing text and one or more images, annotated with gold-standard claims derived from real-world fact-checkers. We evaluate state-of-the-art multimodal LLMs (MLLMs) under a three-part evaluation framework (semantic alignment, faithfulness, and decontextualization) and find that baseline MLLMs struggle to model rhetorical intent and contextual cues. To address this, we introduce MICE, an intent-aware framework which shows improvements in intent-critical cases.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Claim Extraction on MMCE dataset](<https://www.sota2.com/research/sota/claim-extraction-on-mmce-dataset.md>): Claim Extraction; MMCE dataset; Reference-Based Score: 3.25.

- [Claim Extraction on MMCE Intent-Critical](<https://www.sota2.com/research/sota/claim-extraction-on-mmce-intent-critical.md>): Claim Extraction; MMCE Intent-Critical; Reference-Based Score: 3.56.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2604.16311>)

[PDF](<https://arxiv.org/pdf/2604.16311.pdf>)
