# Take It Easy: Label-Adaptive Self-Rationalization for Fact Verification and Explanation Generation

Source: [Take It Easy: Label-Adaptive Self-Rationalization for Fact Verification and Explanation Generation](<https://www.sota2.com/research/paper/68fa75141e209131cea65939>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T03:25:16.855Z

Authors: Jing Yang, Anderson Rocha

Published: 2024-10-05T02:19:49.000Z

## Abstract

Computational methods to aid journalists in the task often require adapting a model to specific domains and generating explanations. However, most automated fact-checking methods rely on three-class datasets, which do not accurately reflect real-world misinformation. Moreover, fact-checking explanations are often generated based on text summarization of evidence, failing to address the relationship between the claim and the evidence. To address these issues, we extend the self-rationalization method--typically used in natural language inference (NLI) tasks--to fact verification. We propose a label-adaptive learning approach: first, we fine-tune a model to learn veracity prediction with annotated labels (step-1 model). Then, we fine-tune the step-1 model again to learn self-rationalization, using the same data and additional annotated explanations. Our results show that our label-adaptive approach improves veracity prediction by more than ten percentage points (Macro F1) on both the PubHealth and AVeriTec datasets, outperforming the GPT-4 model. Furthermore, to address the high cost of explanation annotation, we generated 64 synthetic explanations from three large language models: GPT-4-turbo, GPT-3.5-turbo, and Llama-3-8B and few-shot fine-tune our step-1 model. The few-shot synthetic explanation fine-tuned model performed comparably to the fully fine-tuned self-rationalization model, demonstrating the potential of low-budget learning with synthetic data. Our label-adaptive self-rationalization approach presents a promising direction for future research on real-world explainable fact-checking with different labeling schemes.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Claim Verification on AVeriTeC Golden (dev)](<https://www.sota2.com/research/sota/claim-verification-on-averitec-golden-dev.md>): Claim Verification; AVeriTeC Golden (dev); Accuracy: 81.6.

- [Claim Verification on AVeriTeC Retrieved (I) (dev)](<https://www.sota2.com/research/sota/claim-verification-on-averitec-retrieved-i-dev.md>): Claim Verification; AVeriTeC Retrieved (I) (dev); Accuracy: 66.6.

- [Claim Verification on AVeriTeC Retrieved (H) (dev)](<https://www.sota2.com/research/sota/claim-verification-on-averitec-retrieved-h-dev.md>): Claim Verification; AVeriTeC Retrieved (H) (dev); Accuracy: 63.8.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2410.04002>)

[PDF](<https://arxiv.org/pdf/2410.04002.pdf>)
