Question Answering on HotpotQA (Acc, F1)
56.3Accuracy (Acc)RELOOP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RELOOPAggregation Metric=best2025.10 | 56.3 | 58.6 | |
| RELOOPAggregation Metric=median2025.10 | 55.4 | 57.1 | |
| HippoRAGTask Specialization=Table + text2025.10 | 53.2 | 55.7 | |
| AdaptiveRAGTask Specialization=Graph task2025.10 | 50.3 | 52.5 | |
| Think on Graph (ToG)Category=RAG-based2025.10 | 43.1 | 44.7 | |
| Graph-constrained Reasoning (GcR)Category=RAG-based2025.10 | 39.2 | 41.6 | |
| Falcon-H1-7B-InstructCategory=LLM-only (direct QA)2025.10 | 21.1 | — | |
| Qwen3-4B-Instruct-2507Category=LLM-only (direct QA)2025.10 | 17.8 | — | |
| Falcon3-10B-instructCategory=LLM-only (direct QA)2025.10 | 16.5 | — | |
| Llama-3.1-8B-InstructCategory=LLM-only (direct QA)2025.10 | 14.6 | — |