Multi-hop Question Answering on Multi-hop QA Suite (HotpotQA, 2Wiki, MuSiQue, G-Medical, G-Novel)
59.25Average ScoreMemGraphRAG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MemGraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 59.25 | — | |
| LinearRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 57.15 | 2.1 | |
| HippoRAG2Retrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 55.79 | 3.46 | |
| GFM-RAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 55.27 | 3.98 | |
| LogicRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 52.61 | 6.64 | |
| HippoRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 50.98 | 8.27 | |
| E^2GraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 49.57 | 9.68 | |
| RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=52026.05 | 47.97 | 11.28 | |
| LightRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 47.8 | 11.45 | |
| RAPTORRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 46.13 | 13.12 | |
| RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=32026.05 | 44.87 | 14.38 | |
| KGPRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 44.6 | 14.65 | |
| LazyGraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 41.96 | 17.29 | |
| MS-GraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 41.43 | 17.82 | |
| RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=12026.05 | 38.73 | 20.52 | |
| G-retrieverRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.05 | 36.93 | 22.32 | |
| GPT-4o-miniRetrieval Strategy=Direct Zero-shot LLM Inference2026.05 | 30.99 | 28.26 | |
| GPT-3.5-TurboRetrieval Strategy=Direct Zero-shot LLM Inference2026.05 | 30.15 | 29.1 | |
| Llama3-8BRetrieval Strategy=Direct Zero-shot LLM Inference2026.05 | 20.59 | 38.66 | |
| Llama3-13BRetrieval Strategy=Direct Zero-shot LLM Inference2026.05 | 16.31 | 42.94 |