Fact Verification on FEVER (Acc, F1, FEVER Score)
87.45AccuracyInSemRAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| InSemRAGLLM=DeepSeek2026.05 | 87.45 | 83.65 | 93.55 | |
| SELF-RAGLLM=DeepSeek2026.05 | 86.13 | 82.07 | 92.62 | |
| InSemRAGLLM=GPT2026.05 | 85.12 | 81.25 | 91.05 | |
| IRCoTLLM=DeepSeek2026.05 | 85.09 | 76.51 | 89.62 | |
| SELF-RAGLLM=GPT2026.05 | 83.62 | 79.68 | 89.92 | |
| IRCoTLLM=GPT2026.05 | 82.61 | 74.28 | 87.01 | |
| FiDLLM=DeepSeek2026.05 | 82.49 | 73.53 | 88.9 | |
| InSemRAGLLM=Qwen2026.05 | 81.15 | 77.25 | 86.85 | |
| FiDLLM=GPT2026.05 | 80.09 | 71.39 | 86.31 | |
| ReActLLM=DeepSeek2026.05 | 79.85 | 71.45 | 85.52 | |
| SELF-RAGLLM=Qwen2026.05 | 79.44 | 75.7 | 85.42 | |
| IRCoTLLM=Qwen2026.05 | 78.48 | 70.57 | 82.66 | |
| ReActLLM=GPT2026.05 | 77.52 | 69.37 | 83.03 | |
| Wikipedia GraphLLM=DeepSeek2026.05 | 76.62 | 69.33 | 83.18 | |
| FiDLLM=Qwen2026.05 | 76.09 | 67.82 | 81.99 | |
| Multi-Hop RAGLLM=DeepSeek2026.05 | 75.83 | 70.73 | 84.46 | |
| Wikipedia GraphLLM=GPT2026.05 | 74.39 | 67.31 | 80.76 | |
| ReActLLM=Qwen2026.05 | 73.64 | 65.9 | 78.88 | |
| Multi-Hop RAGLLM=GPT2026.05 | 73.62 | 68.67 | 82 | |
| CoT-on-ConcatLLM=DeepSeek2026.05 | 70.98 | 68.33 | 80.7 | |
| Wikipedia GraphLLM=Qwen2026.05 | 70.67 | 63.94 | 76.72 | |
| Multi-Hop RAGLLM=Qwen2026.05 | 69.94 | 65.24 | 77.9 | |
| CoT-on-ConcatLLM=GPT2026.05 | 68.91 | 66.34 | 78.35 | |
| Naïve RAGLLM=DeepSeek2026.05 | 68.82 | 64.26 | 79.49 | |
| Naïve RAGLLM=GPT2026.05 | 66.82 | 62.39 | 77.17 | |
| CoT-on-ConcatLLM=Qwen2026.05 | 65.46 | 63.02 | 74.43 | |
| w/o RAGLLM=DeepSeek2026.05 | 63.83 | 52.4 | 66.46 | |
| Naïve RAGLLM=Qwen2026.05 | 63.48 | 59.27 | 73.31 | |
| w/o RAGLLM=GPT2026.05 | 61.97 | 50.87 | 64.52 | |
| w/o RAGLLM=Qwen2026.05 | 58.87 | 48.33 | 61.29 |