Long-form RAG Evaluation on RAGChecker
75.6Fact RecallArbGraph
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ArbGraphBackbone=LLaMA-3.1-8B, Paradigm=Ours2026.04 | 75.6 | 99.3 | 41.2 | 4.2 | 3.6 | 36.3 | 4.6 | 51.5 | |
| ArbGraphBackbone=Qwen3-4B, Paradigm=Ours2026.04 | 74.5 | 135.4 | 36.6 | 4.2 | 4.9 | 33.3 | 4.4 | 53.8 | |
| MCTS-RAGBackbone=Qwen3-4B, Paradigm=Agentic2026.04 | 72 | 98.7 | 32.6 | 7 | 10.4 | 36.9 | 4.6 | 50.5 | |
| MCTS-RAGBackbone=LLaMA-3.1-8B, Paradigm=Agentic2026.04 | 71.3 | 96.6 | 33.5 | 9.4 | 9.8 | 43.1 | 5.9 | 39.7 | |
| FIREBackbone=Qwen3-4B, Paradigm=Agentic2026.04 | 70.7 | 59.6 | 34.6 | 11.6 | 8.1 | 48.6 | 7.1 | 37.8 | |
| FIREBackbone=LLaMA-3.1-8B, Paradigm=Agentic2026.04 | 68.7 | 88.2 | 33.1 | 8.7 | 4.7 | 41.8 | 5.3 | 33.6 | |
| CRITICBackbone=LLaMA-3.1-8B, Paradigm=Agentic2026.04 | 62.5 | 78.8 | 32.9 | 13.6 | 5.2 | 56.1 | 7 | 31 | |
| ReActBackbone=LLaMA-3.1-8B, Paradigm=Reasoning2026.04 | 62.1 | 62.6 | 31.5 | 12.2 | 7.7 | — | 7.1 | 25.8 | |
| CoTBackbone=LLaMA-3.1-8B, Paradigm=Reasoning2026.04 | 59.8 | 57.8 | 30.4 | 9.4 | 6.2 | 52.5 | 6.8 | 29.8 | |
| CoTBackbone=Qwen3-4B, Paradigm=Reasoning2026.04 | 57.6 | 110.6 | 28.4 | 7 | 7.9 | 49.5 | 6.8 | 30.1 | |
| CRITICBackbone=Qwen3-4B, Paradigm=Agentic2026.04 | 54.8 | 41.8 | 25 | 4.8 | 5.2 | 45 | 6.9 | 35 | |
| Standard RAGBackbone=LLaMA-3.1-8B, Paradigm=Naive2026.04 | 54.7 | 51.7 | 29.7 | 12.5 | 6 | 59.9 | 6.9 | 29.2 | |
| ReActBackbone=Qwen3-4B, Paradigm=Reasoning2026.04 | 54.4 | 45 | 28.9 | 7.1 | 9.4 | 55.2 | 6.5 | 35.1 | |
| Standard RAGBackbone=Qwen3-4B, Paradigm=Naive2026.04 | 54.3 | 75.8 | 31.5 | 7.9 | 7.7 | 51.4 | 6.6 | 32.2 |