# Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection

Source: [Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection](<https://www.sota2.com/research/paper/68fa69d61e209131cea247a9>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:09:38.543Z

Authors: Nguyen Manh Duc Tuan, Pham Quang Nhat Minh

Published: 2021-04-23T08:47:54.000Z

## Abstract

Fake news detection is an important task for increasing the credibility of information on the media since fake news is constantly spreading on social media every day and it is a very serious concern in our society. Fake news is usually created by manipulating images, texts, and videos. In this paper, we present a novel method for detecting fake news by fusing multimodal features derived from textual and visual data. Specifically, we used a pre-trained BERT model to learn text features and a VGG-19 model pre-trained on the ImageNet dataset to extract image features. We proposed a scale-dot product attention mechanism to capture the relationship between text features and visual features. Experimental results showed that our approach performs better than the current state-of-the-art method on a public Twitter dataset by 3.1% accuracy.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2104.11476>)

[PDF](<https://arxiv.org/pdf/2104.11476.pdf>)