List your company
ResearchFormerly WizWand

Multi-hop Question Answering on HotpotQA (EM, LLM Judge)

80LLM Judge ScoreINSES + Router
14.4831.4948.565.51Mar 14, 2026Mar 26, 2026Apr 8, 2026Apr 21, 2026May 4, 2026May 17, 2026May 30, 2026
Updated 5mo ago

Evaluation results

MethodLinks
INSES + RouterCategory=Ours2026.038068—
Naïve RAGCategory=Text-based, Top-k=102026.037767—
LightRAGCategory=Graph-based2026.037767—
SiReRAGCategory=Graph-based2026.037561—
MemGraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0571.6—67.2
Naïve RAGCategory=Text-based, Top-k=52026.037162—
ConRAGLLM backbone=Gemma-4-31B, Type=Ours2026.0570.4—68.4
RAPTORCategory=Graph-based2026.037068—
Youtu-GraphRAGLLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0569.1—67.4
GFM-RAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0567.7—64.1
LinearRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0567.3—65.3
HippoRAG2Retrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0567.2—65.2
M2RBackbone=Qwen2.5-7B-Instruct2026.0465.9844.11—
E^2GraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0565.7—63.1
LogicRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0565.6—55.8
ReSearchBackbone=Qwen2.5-7B-Instruct2026.0463.6243.52—
ConRAGLLM backbone=GPT-4o-mini, Type=Ours2026.0563.5—63
HyDECategory=Text-based2026.036357—
GraphRAGCategory=Graph-based, Top-k=52026.036343—
LogicRAGLLM backbone=GPT-4o-mini, Type=Reasoning-based RAG2026.0562.6—54.8
LogicRAGLLM backbone=Gemma-4-31B, Type=Reasoning-based RAG2026.0562.4—60.7
KGPRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0562.1—62.7
LightRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0562—61.4
HippoRAG2LLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0561.9—56.7
COFTBackbone=Qwen2.5-7B-Instruct2026.0461.7141.08—
HippoRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0561.4—58.4
GraphRAGCategory=Graph-based, Top-k=102026.036147—
RAPTORRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0561—57
RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=52026.0560.3—58.5
SUREBackbone=Qwen2.5-7B-Instruct2026.0460.1639.56—
RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=32026.0558.9—55.4
RAPTORLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0557.8—48.1
LightRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0557.7—47.8
KGPLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0557.1—46.4
GLM-4Category=LLM only, Protocol=Few-shot CoT2026.035751—
M2RBackbone=Qwen2.5-3B-Instruct2026.0456.4638.7—
HippoRAG2LLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0555.9—54.1
ReSearchBackbone=Qwen2.5-3B-Instruct2026.0455.738.78—
HippoRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0555.6—53.7
HippoRAGLLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0555.3—54.1
Vanilla RAG (Top-5)LLM backbone=GPT-4o-mini, Type=Text RAG2026.0553.9—44.1
Vanilla RAG (Top-3)LLM backbone=GPT-4o-mini, Type=Text RAG2026.0553.1—43.2
Iter-RetGenBackbone=Qwen2.5-7B-Instruct2026.0452.2234.36—
IRCoTBackbone=Qwen2.5-7B-Instruct2026.0452.0630.33—
Vanilla RAG (Top-5)LLM backbone=Gemma-4-31B, Type=Text RAG2026.0552—51.1
SUREBackbone=Qwen2.5-3B-Instruct2026.0451.2335.44—
COFTBackbone=Qwen2.5-3B-Instruct2026.0450.8836.17—
RetrievalRetrieval Strategy=Vanilla Retrieval-Augmented-Generation, Top-k Retrieval=12026.0550.4—48.8
Naive RAGBackbone=Qwen2.5-7B-Instruct2026.0449.5931.9—
LinearRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0549.1—50.1
GLM-4Category=LLM only, Protocol=Direct2026.034941—
Vanilla RAG (Top-1)LLM backbone=GPT-4o-mini, Type=Text RAG2026.0548.6—38.4
Vanilla RAG (Top-3)LLM backbone=Gemma-4-31B, Type=Text RAG2026.0548.3—47.6
IRCoTCategory=Text-based2026.034837—
LinearRAGLLM backbone=Gemma-4-31B, Type=Graph-based RAG2026.0546.1—45.7
GraphRAGLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0545.2—39.6
LazyGraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0543.8—52.7
MS-GraphRAGRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0543.5—51.6
GPT-3.5-TurboRetrieval Strategy=Direct Zero-shot LLM Inference2026.0542.5—32.7
Iter-RetGenBackbone=Qwen2.5-3B-Instruct2026.0442.2224.63—
G-retrieverRetrieval Strategy=Graph-based Retrieval-Augmented-Generation2026.0541.8—44
G-RetrieverLLM backbone=GPT-4o-mini, Type=Graph-based RAG2026.0540.9—28.5
IRCoTBackbone=Qwen2.5-3B-Instruct2026.0440.623.63—
GPT-4o-miniRetrieval Strategy=Direct Zero-shot LLM Inference2026.0539.7—38.1
Vanilla RAG (Top-1)LLM backbone=Gemma-4-31B, Type=Text RAG2026.0538.1—39.2
Naive RAGBackbone=Qwen2.5-3B-Instruct2026.0437.2321.04—
Zero-shotLLM backbone=GPT-4o-mini, Type=Direct LLM2026.0536.3—38.7
Naive GenerationBackbone=Qwen2.5-7B-Instruct2026.0430.6419.18—
Zero-shotLLM backbone=Gemma-4-31B, Type=Direct LLM2026.0530.6—31.5
Llama3-8BRetrieval Strategy=Direct Zero-shot LLM Inference2026.0528.2—30.8
Naive GenerationBackbone=Qwen2.5-3B-Instruct2026.0418.4512.05—
Llama3-13BRetrieval Strategy=Direct Zero-shot LLM Inference2026.0517—24.9
AdaptiveRAGTraining Paradigm=Training-free, Backbone=Qwen2.5-7B2026.06—37.1—
AR W/ RET@1Training Paradigm=Training-free, Backbone=Qwen2.5-7B, Retrieval Strategy=RET@12026.06—47.4—
AR W/ RET@10Training Paradigm=Training-free, Backbone=Qwen2.5-7B, Retrieval Strategy=RET@102026.06—45.1—
AR W/ RET@ADAPTIVETraining Paradigm=Training-free, Backbone=Qwen2.5-7B, Retrieval Strategy=ADAPTIVE2026.06—37.3—
AR W/ RET@STATICTraining Paradigm=Training-free, Backbone=Qwen2.5-7B, Retrieval Strategy=STATIC2026.06—40.3—
DLM W/ RET@STATICTraining Paradigm=Training-free, Backbone=DREAM-7B, Retrieval Strategy=STATIC, Diffusion Threshold (tau_c)=0.92026.06—39.9—
ReActTraining Paradigm=Training-free, Backbone=Qwen2.5-7B2026.06—40.1—
SARDITraining Paradigm=Training-free, Backbone=DREAM-7B, Retrieval Strategy=SARDI, Diffusion Threshold (tau_c)=0.92026.06—48.5—
SARDITraining Paradigm=Training-free, Backbone=DREAM-7B, Retrieval Strategy=SARDI, Diffusion Threshold (tau_c)=0.952026.06—48.7—
Search-R1Training Paradigm=RL-trained, Backbone=Qwen2.5-7B2026.06—50.3—