Question Answering on MetaQA 3-hop (Acc/F1)
93.4AccuracyRELOOP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RELOOPAggregation Metric=best2025.10 | 93.4 | 88.3 | |
| RELOOPAggregation Metric=median2025.10 | 90.1 | 86.6 | |
| AdaptiveRAGTask Specialization=Graph task2025.10 | 84.5 | 85.7 | |
| Graph-constrained Reasoning (GcR)Category=RAG-based2025.10 | 83.2 | 80.6 | |
| Think on Graph (ToG)Category=RAG-based2025.10 | 81.1 | 78.5 | |
| Falcon-H1-7B-InstructCategory=LLM-only (direct QA)2025.10 | 44.6 | — | |
| Falcon3-10B-instructCategory=LLM-only (direct QA)2025.10 | 39.8 | — | |
| Qwen3-4B-Instruct-2507Category=LLM-only (direct QA)2025.10 | 38.5 | — | |
| Llama-3.1-8B-InstructCategory=LLM-only (direct QA)2025.10 | 31.9 | — | |
| Graph-S^3Generator=Finetuned-7B2025.10 | 14.7 | 36.29 | |
| Graph-S^3Generator=Qwen2-7B2025.10 | 12.73 | 29.49 | |
| Graph-S^3Generator=Llama3-8B2025.10 | 10.73 | 29.55 | |
| RAG/1hopGenerator=Qwen2-7B2025.10 | 4.13 | 11.99 | |
| KG-AgentGenerator=Qwen2-7B2025.10 | 4.07 | 10.89 | |
| RAG/1hopGenerator=Llama3-8B2025.10 | 4.03 | 15.46 | |
| KG-AgentGenerator=Llama3-8B2025.10 | 3.85 | 8.29 | |
| RAG/1hopGenerator=Finetuned-7B2025.10 | 3.3 | 18.61 | |
| RAG/2hopGenerator=Finetuned-7B2025.10 | 3.07 | 14.04 | |
| KG-AgentGenerator=Finetuned-7B2025.10 | 2.64 | 7.2 | |
| RAG/2hopGenerator=Qwen2-7B2025.10 | 2.6 | 9.42 | |
| RAG/2hopGenerator=Llama3-8B2025.10 | 1.8 | 11.3 | |
| ToGGenerator=Llama3-8B2025.10 | 1.43 | 6.1 | |
| No graphGenerator=Llama3-8B2025.10 | 1.23 | 8.86 | |
| LightRAGGenerator=Llama3-8B2025.10 | 1 | 6.38 | |
| LightRAGGenerator=Finetuned-7B2025.10 | 0.53 | 4.28 | |
| G-retrieverGenerator=Finetuned-7B2025.10 | 0.4 | 3.31 | |
| No graphGenerator=Finetuned-7B2025.10 | 0.33 | 4.6 | |
| No graphGenerator=Qwen2-7B2025.10 | 0.2 | 1.19 | |
| RAG/3hopGenerator=Qwen2-7B2025.10 | 0.13 | 3.45 | |
| RAG/3hopGenerator=Finetuned-7B2025.10 | 0.13 | 4.23 | |
| G-retrieverGenerator=Llama3-8B2025.10 | 0.1 | 1.77 | |
| ToGGenerator=Finetuned-7B2025.10 | 0.1 | 2.8 | |
| LightRAGGenerator=Qwen2-7B2025.10 | 0.07 | 0.4 | |
| RAG/3hopGenerator=Llama3-8B2025.10 | 0.07 | 5.76 | |
| G-retrieverGenerator=Qwen2-7B2025.10 | 0.03 | 1.87 | |
| No retrieverGenerator=Qwen2-7B2025.10 | 0 | 1.25 | |
| ToGGenerator=Qwen2-7B2025.10 | 0 | 0.2 | |
| No retrieverGenerator=Llama3-8B2025.10 | 0 | 2.94 | |
| No retrieverGenerator=Finetuned-7B2025.10 | 0 | 1.05 |