Multi-hop Question Answering on MultihopQA
59.664AccuracyVGraphRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VGraphRAGprotocol=RAG2025.03 | 59.664 | 50.893 | |
| VGraphRAG2025.03 | 59.664 | 50.893 | |
| RAPTORprotocol=RAG2025.03 | 56.064 | 44.832 | |
| RAPTORLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token, Clustering method=Gaussian Mixture2025.03 | 56.064 | 44.832 | |
| RAPTOR2025.03 | 56.064 | 44.832 | |
| LGraphRAGprotocol=RAG2025.03 | 55.36 | 50.429 | |
| LGraphRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 55.36 | 50.429 | |
| LGraphRAG2025.03 | 55.36 | 50.429 | |
| VGraphRAG-CCprotocol=RAG2025.03 | 55.203 | 46.75 | |
| DALKLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 53.952 | 47.232 | |
| HippoRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 53.76 | 47.671 | |
| FastGraphRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 52.895 | 44.278 | |
| GraphRAG-ERprotocol=RAG2025.03 | 52.739 | 45.113 | |
| GraphRAG-CCprotocol=RAG2025.03 | 52.113 | 43.77 | |
| VanillaRAGprotocol=RAG2025.03 | 50.626 | 36.918 | |
| VanillaRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 50.626 | 36.918 | |
| HLightRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 50.313 | 41.613 | |
| ZeroShotprotocol=Zero-shot2025.03 | 49.022 | 34.526 | |
| ZeroShotLLM=Llama-3-8B2025.03 | 49.022 | 34.256 | |
| GLightRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 48.474 | 38.365 | |
| KGPLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 48.161 | 36.272 | |
| LLightRAGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 44.053 | 35.528 | |
| G-retrieverLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 42.019 | 43.116 | |
| ToGLLM=Llama-3-8B, Embedding model=BGE-M3, top-k=4, chunk size=1,200-token2025.03 | 41.941 | 38.435 |