List your company
ResearchFormerly WizWand

Multi-hop Question Answering on MuSiQue (Str-Acc, LLM-Acc)

48.4String AccuracyConRAG
2.43214.36626.338.234May 27, 2026May 28, 2026May 29, 2026May 30, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ConRAGLLM backbone=Gemma-4-31B, Type=Ours2026.0548.452.3
Youtu-GraphRAGLLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0543.848.3
ConRAGLLM backbone=GPT-4o-mini, Type=Ours2026.0540.641.8
MemGraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0534.437.9
LinearRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0533.237.2
GFM-RAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0532.536.1
HippoRAG2Retrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0532.238.3
LogicRAGLLM backbone=Gemma-4-31B, Type=Reasoning-based RAG2026.0532.137.2
LogicRAGLLM backbone=GPT-4o-mini, Type=Reasoning-based RAG2026.0530.437.5
HippoRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0530.426
LogicRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0530.134.6
LightRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0528.630.5
KGPRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0528.432.5
RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=52026.0528.332
HippoRAG2LLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.052732.6
RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=32026.0526.628.5
E^2GraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0526.129
HippoRAG2LLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0525.727.9
HippoRAGLLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0525.427.6
RAPTORLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0525.229.1
Vanilla RAG (Top-5)LLM backbone=Gemma-4-31B, Type=Text RAG2026.0525.227.4
HippoRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0524.930.1
RAPTORRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0524.728.9
KGPLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0523.327.5
Vanilla RAG (Top-3)LLM backbone=Gemma-4-31B, Type=Text RAG2026.052222.7
LazyGraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0521.524.8
Vanilla RAG (Top-5)LLM backbone=GPT-4o-mini, Type=Text RAG2026.052123.6
MS-GraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0520.623.7
Vanilla RAG (Top-3)LLM backbone=GPT-4o-mini, Type=Text RAG2026.0520.323.6
RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=12026.0519.923.8
LinearRAGLLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0518.319.7
LightRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0518.119.4
Zero-shotLLM backbone=GPT-4o-mini, Type=Direct LLM2026.0517.614
LinearRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0517.417.9
GraphRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0516.523.1
G-retrieverRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0516.217.6
GPT-4o-miniRetrieval Strategy=Direct Zero-shot LLM Inference2026.0514.115.2
Vanilla RAG (Top-1)LLM backbone=Gemma-4-31B, Type=Text RAG2026.051414.7
Vanilla RAG (Top-1)LLM backbone=GPT-4o-mini, Type=Text RAG2026.0513.218.5
GPT-3.5-TurboRetrieval Strategy=Direct Zero-shot LLM Inference2026.0510.121.4
Zero-shotLLM backbone=Gemma-4-31B, Type=Direct LLM2026.059.39.3
G-RetrieverLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.059.115.6
Llama3-8BRetrieval Strategy=Direct Zero-shot LLM Inference2026.056.77.4
Llama3-13BRetrieval Strategy=Direct Zero-shot LLM Inference2026.054.25