Question Answering on MetaQA 2-hop (Acc, F1)
95.9AccuracyRELOOP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RELOOPAggregation Metric=best2025.10 | 95.9 | 91.1 | |
| RELOOPAggregation Metric=median2025.10 | 93.2 | 89.7 | |
| AdaptiveRAGTask Specialization=Graph task2025.10 | 88.2 | 90.1 | |
| Graph-constrained Reasoning (GcR)Category=RAG-based2025.10 | 86.7 | 88.1 | |
| Think on Graph (ToG)Category=RAG-based2025.10 | 83.2 | 84.8 | |
| Graph-S^3Generator=Finetuned-7B2025.10 | 63.17 | 76.18 | |
| Graph-S^3Generator=Qwen2-7B2025.10 | 53.73 | 65.6 | |
| Falcon-H1-7B-InstructCategory=LLM-only (direct QA)2025.10 | 48.3 | — | |
| Falcon3-10B-instructCategory=LLM-only (direct QA)2025.10 | 43 | — | |
| Qwen3-4B-Instruct-2507Category=LLM-only (direct QA)2025.10 | 42.2 | — | |
| Graph-S^3Generator=Llama3-8B2025.10 | 40.17 | 55.49 | |
| Llama-3.1-8B-InstructCategory=LLM-only (direct QA)2025.10 | 37.8 | — | |
| KG-AgentGenerator=Llama3-8B2025.10 | 32.51 | 44.52 | |
| KG-AgentGenerator=Finetuned-7B2025.10 | 30.19 | 43.95 | |
| KG-AgentGenerator=Qwen2-7B2025.10 | 28.41 | 33.66 | |
| RAG/2hopGenerator=Qwen2-7B2025.10 | 10.07 | 21.65 | |
| RAG/2hopGenerator=Finetuned-7B2025.10 | 7.7 | 21.21 | |
| RAG/2hopGenerator=Llama3-8B2025.10 | 4.5 | 15.06 | |
| RAG/1hopGenerator=Llama3-8B2025.10 | 2.4 | 5.98 | |
| G-retrieverGenerator=Finetuned-7B2025.10 | 2.33 | 4.8 | |
| RAG/1hopGenerator=Finetuned-7B2025.10 | 1.83 | 7.44 | |
| No graphGenerator=Llama3-8B2025.10 | 1.27 | 7.77 | |
| LightRAGGenerator=Finetuned-7B2025.10 | 0.97 | 3.71 | |
| LightRAGGenerator=Llama3-8B2025.10 | 0.93 | 4.33 | |
| RAG/1hopGenerator=Qwen2-7B2025.10 | 0.77 | 1.74 | |
| No graphGenerator=Finetuned-7B2025.10 | 0.43 | 2.64 | |
| RAG/3hopGenerator=Finetuned-7B2025.10 | 0.43 | 2.31 | |
| RAG/3hopGenerator=Llama3-8B2025.10 | 0.17 | 3.37 | |
| RAG/3hopGenerator=Qwen2-7B2025.10 | 0.13 | 2.21 | |
| G-retrieverGenerator=Qwen2-7B2025.10 | 0.1 | 0.77 | |
| G-retrieverGenerator=Llama3-8B2025.10 | 0.1 | 0.83 | |
| No graphGenerator=Qwen2-7B2025.10 | 0.07 | 0.95 | |
| No retrieverGenerator=Qwen2-7B2025.10 | 0 | 0.49 | |
| ToGGenerator=Qwen2-7B2025.10 | 0 | 0 | |
| LightRAGGenerator=Qwen2-7B2025.10 | 0 | 0.19 | |
| No retrieverGenerator=Llama3-8B2025.10 | 0 | 1.11 | |
| ToGGenerator=Llama3-8B2025.10 | 0 | 0.63 | |
| No retrieverGenerator=Finetuned-7B2025.10 | 0 | 0.34 | |
| ToGGenerator=Finetuned-7B2025.10 | 0 | 0.12 |