# Language Models as Fact Checkers?

Source: [Language Models as Fact Checkers?](<https://www.sota2.com/research/paper/68fa680d1e209131cea19dfa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:28:00.017Z

Authors: Nayeon Lee, Belinda Z. Li, Sinong Wang, Wen-tau Yih, Hao Ma, Madian Khabsa

Published: 2020-06-07T09:52:05.000Z

## Abstract

Recent work has suggested that language models (LMs) store both common-sense and factual knowledge learned from pre-training data. In this paper, we leverage this implicit knowledge to create an effective end-to-end fact checker using a solely a language model, without any external knowledge or explicit retrieval components. While previous work on extracting knowledge from LMs have focused on the task of open-domain question answering, to the best of our knowledge, this is the first work to examine the use of language models as fact checkers. In a closed-book setting, we show that our zero-shot LM approach outperforms a random baseline on the standard FEVER task, and that our fine-tuned LM compares favorably with standard baselines. Though we do not ultimately outperform methods which use explicit knowledge bases, we believe our exploration shows that this method is viable and has much room for exploration.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Fact Verification on FEVER S R](<https://www.sota2.com/research/sota/fact-verification-on-fever-s-r.md>): Fact Verification; FEVER S R; Precision: 77.9.

- [Fact Verification on FEVER-Symmetric](<https://www.sota2.com/research/sota/fact-verification-on-fever-symmetric.md>): Fact Verification; FEVER-Symmetric; Precision: 71.2.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2006.04102>)

[PDF](<https://arxiv.org/pdf/2006.04102.pdf>)
