# Fact Verification on FEVER (Acc, F1, FEVER Score)

Source: [Fact Verification on FEVER (Acc, F1, FEVER Score)](<https://www.sota2.com/research/sota/fact-verification-on-fever-acc-f1-fever-score>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T10:41:43.692Z

Evaluation of model performance on the FEVER dataset for Fact Verification, reporting Accuracy, F1 Score, and the specialized FEVER Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fact verification |
| Dataset (including any stated split) | FEVER |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 30 of 30 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/fact-verification-on-fever-acc-f1-fever-score.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [FEVER Score](<https://www.sota2.com/research/sota/fact-verification-on-fever-acc-f1-fever-score.md?metric=FEVER%20Score>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/fact-verification-on-fever-acc-f1-fever-score.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| InSemRAG | 87.45 | Not recorded | 6a1e6408dbd7150506f85623 |
| SELF-RAG | 86.13 | Not recorded | 6a1e6408dbd7150506f85623 |
| InSemRAG | 85.12 | Not recorded | 6a1e6408dbd7150506f85623 |
| IRCoT | 85.09 | Not recorded | 6a1e6408dbd7150506f85623 |
| SELF-RAG | 83.62 | Not recorded | 6a1e6408dbd7150506f85623 |
| IRCoT | 82.61 | Not recorded | 6a1e6408dbd7150506f85623 |
| FiD | 82.49 | Not recorded | 6a1e6408dbd7150506f85623 |
| InSemRAG | 81.15 | Not recorded | 6a1e6408dbd7150506f85623 |
| FiD | 80.09 | Not recorded | 6a1e6408dbd7150506f85623 |
| ReAct | 79.85 | Not recorded | 6a1e6408dbd7150506f85623 |
| SELF-RAG | 79.44 | Not recorded | 6a1e6408dbd7150506f85623 |
| IRCoT | 78.48 | Not recorded | 6a1e6408dbd7150506f85623 |
| ReAct | 77.52 | Not recorded | 6a1e6408dbd7150506f85623 |
| Wikipedia Graph | 76.62 | Not recorded | 6a1e6408dbd7150506f85623 |
| FiD | 76.09 | Not recorded | 6a1e6408dbd7150506f85623 |
| Multi-Hop RAG | 75.83 | Not recorded | 6a1e6408dbd7150506f85623 |
| Wikipedia Graph | 74.39 | Not recorded | 6a1e6408dbd7150506f85623 |
| ReAct | 73.64 | Not recorded | 6a1e6408dbd7150506f85623 |
| Multi-Hop RAG | 73.62 | Not recorded | 6a1e6408dbd7150506f85623 |
| CoT-on-Concat | 70.98 | Not recorded | 6a1e6408dbd7150506f85623 |
| Wikipedia Graph | 70.67 | Not recorded | 6a1e6408dbd7150506f85623 |
| Multi-Hop RAG | 69.94 | Not recorded | 6a1e6408dbd7150506f85623 |
| CoT-on-Concat | 68.91 | Not recorded | 6a1e6408dbd7150506f85623 |
| Naïve RAG | 68.82 | Not recorded | 6a1e6408dbd7150506f85623 |
| Naïve RAG | 66.82 | Not recorded | 6a1e6408dbd7150506f85623 |
| CoT-on-Concat | 65.46 | Not recorded | 6a1e6408dbd7150506f85623 |
| w/o RAG | 63.83 | Not recorded | 6a1e6408dbd7150506f85623 |
| Naïve RAG | 63.48 | Not recorded | 6a1e6408dbd7150506f85623 |
| w/o RAG | 61.97 | Not recorded | 6a1e6408dbd7150506f85623 |
| w/o RAG | 58.87 | Not recorded | 6a1e6408dbd7150506f85623 |

### InSemRAG

Accuracy: 87.45. Result ID: 6a1eb34dfbc373592c199ca5.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### SELF-RAG

Accuracy: 86.13. Result ID: 6a1eb34dfbc373592c199c9f.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e51e209131cea4dc1c.md>)

[Implementation](<https://selfrag.github.io/>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### InSemRAG

Accuracy: 85.12. Result ID: 6a1eb34dfbc373592c199ca3.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### IRCoT

Accuracy: 85.09. Result ID: 6a1eb34dfbc373592c199c9c.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### SELF-RAG

Accuracy: 83.62. Result ID: 6a1eb34dfbc373592c199c9d.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e51e209131cea4dc1c.md>)

[Implementation](<https://selfrag.github.io/>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### IRCoT

Accuracy: 82.61. Result ID: 6a1eb34dfbc373592c199c9a.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### FiD

Accuracy: 82.49. Result ID: 6a1eb34dfbc373592c199c96.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69381e209131cea20e9a.md>)

[Implementation](<https://www.sota2.com/github.com/facebookresearch/faiss>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### InSemRAG

Accuracy: 81.15. Result ID: 6a1eb34dfbc373592c199ca4.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### FiD

Accuracy: 80.09. Result ID: 6a1eb34dfbc373592c199c94.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69381e209131cea20e9a.md>)

[Implementation](<https://www.sota2.com/github.com/facebookresearch/faiss>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### ReAct

Accuracy: 79.85. Result ID: 6a1eb34dfbc373592c199c99.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb41e209131cea41992.md>)

[Implementation](<https://react-lm.github.io/>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### SELF-RAG

Accuracy: 79.44. Result ID: 6a1eb34dfbc373592c199c9e.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e51e209131cea4dc1c.md>)

[Implementation](<https://selfrag.github.io/>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### IRCoT

Accuracy: 78.48. Result ID: 6a1eb34dfbc373592c199c9b.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### ReAct

Accuracy: 77.52. Result ID: 6a1eb34dfbc373592c199c97.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb41e209131cea41992.md>)

[Implementation](<https://react-lm.github.io/>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### Wikipedia Graph

Accuracy: 76.62. Result ID: 6a1eb34dfbc373592c199c93.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### FiD

Accuracy: 76.09. Result ID: 6a1eb34dfbc373592c199c95.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69381e209131cea20e9a.md>)

[Implementation](<https://www.sota2.com/github.com/facebookresearch/faiss>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### Multi-Hop RAG

Accuracy: 75.83. Result ID: 6a1eb34dfbc373592c199ca2.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72011e209131cea540fb.md>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### Wikipedia Graph

Accuracy: 74.39. Result ID: 6a1eb34dfbc373592c199c91.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### ReAct

Accuracy: 73.64. Result ID: 6a1eb34dfbc373592c199c98.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb41e209131cea41992.md>)

[Implementation](<https://react-lm.github.io/>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### Multi-Hop RAG

Accuracy: 73.62. Result ID: 6a1eb34dfbc373592c199ca0.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72011e209131cea540fb.md>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### CoT-on-Concat

Accuracy: 70.98. Result ID: 6a1eb34dfbc373592c199c90.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### Wikipedia Graph

Accuracy: 70.67. Result ID: 6a1eb34dfbc373592c199c92.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### Multi-Hop RAG

Accuracy: 69.94. Result ID: 6a1eb34dfbc373592c199ca1.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72011e209131cea540fb.md>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### CoT-on-Concat

Accuracy: 68.91. Result ID: 6a1eb34dfbc373592c199c8e.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### Naïve RAG

Accuracy: 68.82. Result ID: 6a1eb34dfbc373592c199c8d.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### Naïve RAG

Accuracy: 66.82. Result ID: 6a1eb34dfbc373592c199c8b.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### CoT-on-Concat

Accuracy: 65.46. Result ID: 6a1eb34dfbc373592c199c8f.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### w/o RAG

Accuracy: 63.83. Result ID: 6a1eb34dfbc373592c199c8a.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"DeepSeek"}. This record does not assert independent reproduction.

### Naïve RAG

Accuracy: 63.48. Result ID: 6a1eb34dfbc373592c199c8c.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

### w/o RAG

Accuracy: 61.97. Result ID: 6a1eb34dfbc373592c199c88.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"GPT"}. This record does not assert independent reproduction.

### w/o RAG

Accuracy: 58.87. Result ID: 6a1eb34dfbc373592c199c89.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6408dbd7150506f85623.md>)

Recorded evaluation configuration: {"LLM":"Qwen"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
