Question Answering on MultiHop-RAG
68.8Exact Match (EM)ArchRAG
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ArchRAGBaseline Type=Our proposed2025.02 | 68.8 | — | 37.2 | — | |
| RAPTORBaseline Type=Graph-based RAG2025.02 | 59.1 | — | 34.1 | — | |
| Vanilla RAGBaseline Type=Retrieval-only2025.02 | 58.6 | — | 31.4 | — | |
| Ψ-RAG ⍋Type=Tree-RAG, Reranker=Qwen3-Reranker-8B (Q3R), Abstract Type=summative2026.05 | 55.3 | 56.23 | — | — | |
| CoTBaseline Type=Inference-only2025.02 | 54.5 | — | 28.7 | — | |
| Ψ-RAG øType=Tree-RAG, Reranker=Qwen3-Reranker-8B (Q3R), Abstract Type=keyword2026.05 | 54.1 | 55.18 | — | — | |
| BM25 + DPR + Q3RType=Traditional RAG, Reranker=Qwen3-Reranker-8B (Q3R)2026.05 | 52.9 | 53.49 | — | — | |
| HyLightRAGBaseline Type=Graph-based RAG2025.02 | 50.3 | — | 30.3 | — | |
| HLightRAGBaseline Type=Graph-based RAG2025.02 | 48.5 | — | 28.7 | — | |
| Zero-shotBaseline Type=Inference-only2025.02 | 47.7 | — | 23.6 | — | |
| GGraphRAGBaseline Type=Graph-based RAG2025.02 | 45.9 | — | 28.4 | — | |
| LLightRAGBaseline Type=Graph-based RAG2025.02 | 44.1 | — | 25.1 | — | |
| RAPTOR + Q3RType=Tree-RAG, Reranker=Qwen3-Reranker-8B (Q3R)2026.05 | 42.5 | 43.2 | — | — | |
| DPR + IRCoT + Q3RType=Traditional RAG, Reranker=Qwen3-Reranker-8B (Q3R), Iterative Retrieval Protocol=IRCoT2026.05 | 41.7 | 42.28 | — | — | |
| DPRType=Traditional RAG2026.05 | 41.3 | 42.72 | — | — | |
| LGraphRAGBaseline Type=Graph-based RAG2025.02 | 40.1 | — | 23.8 | — | |
| HippoRAGBaseline Type=Graph-based RAG2025.02 | 38.9 | — | 19.1 | — | |
| BM25Baseline Type=Retrieval-only2025.02 | 37.6 | — | 19.4 | — | |
| GraphRAGType=Graph-RAG2026.05 | 37.3 | 39.08 | — | — | |
| HippoRAG 2Type=Graph-RAG2026.05 | 17.7 | 19.36 | — | — | |
| HippoRAG 2 + Q3RType=Graph-RAG, Reranker=Qwen3-Reranker-8B (Q3R)2026.05 | 17.6 | 19.37 | — | — | |
| BM25Type=Traditional RAG2026.05 | 2.5 | 3.93 | — | — | |
| CoTBase LLM=Qwen3-8B2026.06 | — | — | 31.37 | 60.02 | |
| EraRAGBase LLM=Qwen3-8B2026.06 | — | — | 36.85 | 61.78 | |
| HippoRAGBase LLM=Qwen3-8B2026.06 | — | — | 33.54 | 61.89 | |
| HippoRAG2Base LLM=Qwen3-8B2026.06 | — | — | 36.24 | 63.97 | |
| HyGRAGBase LLM=Qwen3-8B2026.06 | — | — | 45.09 | 73.87 | |
| L-GraphRAGBase LLM=Qwen3-8B2026.06 | — | — | 38.04 | 55.2 | |
| L-LightRAGBase LLM=Qwen3-8B2026.06 | — | — | 38.25 | 55.52 | |
| RAPTORBase LLM=Qwen3-8B2026.06 | — | — | 36.66 | 60.13 | |
| VanillaRAGBase LLM=Qwen3-8B2026.06 | — | — | 37.4 | 61.93 | |
| Zero-shotBase LLM=Qwen3-8B2026.06 | — | — | 27.33 | 47.1 |