List your company
ResearchFormerly WizWand

Multi-hop Question Answering on MARCH

73Exact Match (EM)Human
13.293628.794344.29559.7957Sep 26, 2025
Updated 7mo ago

Evaluation results

MethodLinks
HumanModel=N/A2025.09736267.5—
CLARIONModel=Qwen3-235b2025.0938.7328.3833.563.474
CLARIONModel=DeepSeek-v3.12025.0931.4727.0329.253.042
CLARIONModel=Gemini-2.52025.0929.1226.327.712.752
DIVAModel=Qwen3-235b2025.0928.8222.7325.783.015
CoT w/ RAGModel=Qwen3-235b2025.0925.6326.6126.122.947
NaiveRAGModel=Qwen3-235b2025.0925.126.225.652.752
CLARION w/o clarificationModel=Qwen3-235b2025.0925.125.5625.332.922
CLARION w/o clarification & detectionModel=DeepSeek-v3.12025.0924.5124.3124.412.906
CLARION w/o clarificationModel=Gemini-2.52025.0924.1222.5423.332.609
CLARION w/o clarification & detectionModel=Gemini-2.52025.0923.8222.0422.932.573
CLARION w/o clarificationModel=DeepSeek-v3.12025.0923.6322.9923.312.927
ReActModel=DeepSeek-v3.12025.0923.1724.7823.972.723
CoT w/ RAGModel=Gemini-2.52025.0923.1527.3125.232.373
CLARION w/o clarification & detectionModel=Qwen3-235b2025.0922.9424.0223.482.782
NaiveRAGModel=Gemini-2.52025.0922.1628.6325.42.297
CoTModel=Qwen3-235b2025.0921.5122.3221.912.897
CoT w/ RAGModel=DeepSeek-v3.12025.0921.3323.1822.252.632
ReActModel=Gemini-2.52025.0921.3222.3721.842.428
No RetrievalModel=Qwen3-235b2025.0920.9821.1921.093.083
ReActModel=Qwen3-235b2025.0920.982120.992.832
NaiveRAGModel=DeepSeek-v3.12025.0920.225.0322.622.084
CoTModel=DeepSeek-v3.12025.0919.822.1220.962.512
DIVAModel=Gemini-2.52025.0918.8220.2919.562.303
DIVAModel=DeepSeek-v3.12025.0918.8220.6619.742.636
No RetrievalModel=DeepSeek-v3.12025.0917.7518.7218.242.683
CoTModel=Gemini-2.52025.0916.3217.5216.922.258
No RetrievalModel=Gemini-2.52025.0915.5920.117.852.307