Claim Verification on 9-dataset aggregate retrieval-free setting (test)
84ROC-AUCGPT-4.1
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4.1Retrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 84 | 78.3 | |
| Verb+RAGRetrieval setting=Retrieval-Based, Backbone=Ministral2026.03 | 78.2 | 69.6 | |
| Verb+RAGRetrieval setting=Retrieval-Based, Backbone=Llama 3.12026.03 | 77.7 | 70.1 | |
| INTRARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 77.7 | 73.1 | |
| Verb+RAGRetrieval setting=Retrieval-Based, Backbone=Avg2026.03 | 77.5 | 68.9 | |
| Verb+RAGRetrieval setting=Retrieval-Based, Backbone=Phi-42026.03 | 76.5 | 67.1 | |
| SheepsRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 75 | 70.5 | |
| VerbRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 74.7 | 68.4 | |
| MMRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 73.3 | 68.7 | |
| INTRARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 73.3 | 69 | |
| CCSRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 73.1 | 68.9 | |
| INTRARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 72.8 | 69.3 | |
| VerbRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 72.2 | 66.5 | |
| VerbRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 72 | 64.5 | |
| SheepsRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 72 | 67.6 | |
| SheepsRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 71.6 | 67.6 | |
| MMRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 71.4 | 68.3 | |
| CCSRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 71.1 | 64.1 | |
| SPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 70.9 | 66.9 | |
| MINDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 70.6 | 67 | |
| SAPLMARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 70.2 | 66.1 | |
| MINDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 70 | 65.4 | |
| CCPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 69.8 | 67.6 | |
| SATRMDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 69.6 | 65.5 | |
| INTRARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 69.5 | 64.6 | |
| SheepsRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 69.4 | 64.6 | |
| VerbRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 69.1 | 64.5 | |
| MINDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 69.1 | 65.6 | |
| SPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 69 | 64.9 | |
| SPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 68.8 | 64.9 | |
| PPLRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 68.6 | 65.6 | |
| SAPLMARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 68.4 | 64.5 | |
| SAPLMARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 68 | 64.4 | |
| MMRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 67.8 | 64.7 | |
| PPLRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 67.5 | 64.3 | |
| PPLRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 67.3 | 64.2 | |
| CCPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 67.1 | 65.5 | |
| MINDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 66.8 | 64.4 | |
| PPLRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 66.6 | 63.1 | |
| SATRMDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 66.6 | 63.1 | |
| SPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 66.4 | 62.8 | |
| CCSRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 65.7 | 61.6 | |
| TADRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 65.7 | 62.4 | |
| SAPLMARetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 65.4 | 62.6 | |
| SATRMDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 65.3 | 62.5 | |
| SATRMDRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 64.9 | 61.2 | |
| TADRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Phi-42026.03 | 64.7 | 61.2 | |
| TADRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Avg2026.03 | 64.7 | 61.5 | |
| RAUQRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 63.9 | 61.1 | |
| RAUQRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 63.8 | 60.7 | |
| TADRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 63.8 | 60.9 | |
| FocusRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 63.6 | 60.6 | |
| RAUQRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 63.1 | 60.2 | |
| UHeadRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Llama 3.12026.03 | 63.1 | 60.2 | |
| MTERetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 62.5 | 59 | |
| CCPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 61.9 | 60.8 | |
| FocusRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 61.9 | 58.9 | |
| RAUQRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 61.6 | 58.6 | |
| MTERetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 61.4 | 57.9 | |
| MTERetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 60.9 | 58 | |
| MTERetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 60.8 | 56.6 | |
| MMRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 58.7 | 57.1 | |
| FocusRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 58.6 | 58.2 | |
| CCSRetrieval setting=Retrieval-Free, Supervision level=Supervised, Backbone=Ministral2026.03 | 53 | 51.8 | |
| Att. ScoreRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Ministral2026.03 | 51.1 | 51 | |
| Att. ScoreRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Avg2026.03 | 50.5 | 50.6 | |
| Att. ScoreRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 50.3 | 50.6 | |
| FocusRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 50.2 | 55.1 | |
| Att. ScoreRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Llama 3.12026.03 | 50 | 50.2 | |
| CCPRetrieval setting=Retrieval-Free, Supervision level=Unsupervised, Backbone=Phi-42026.03 | 48.6 | 49.2 |