List your company
ResearchFormerly WizWand

General Question Answering on NQ (Natural Questions) (EM, F1aware)

46.1EMSearch-R1
6.5816.8427.137.36Dec 18, 2025Jan 4, 2026Jan 21, 2026Feb 7, 2026Feb 24, 2026Mar 13, 2026Mar 31, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Search-R1Base Model=Llama-3.2-3B-Instruct, Category=Outcome RL Baselines2025.1246.11.7
ADASEARCHBase Model=Llama-3.2-3B-Instruct, Category=Paper Method2025.1243.562.7
Search-R1Base Model=Qwen2.5-3B-Instruct, Category=Outcome RL Baselines2025.1242.70
GraphRAG-RouterSystem=Our Method2026.0342.6—
IKEABase Model=Llama-3.2-3B-Instruct, Category=Reward-Shaping Baselines2025.1242.258.6
IKEABase Model=Qwen2.5-3B-Instruct, Category=Reward-Shaping Baselines2025.1241.437.7
Awareness ShapingBase Model=Llama-3.2-3B-Instruct, Category=Reward-Shaping Baselines2025.1241.458.8
Naive ShapingBase Model=Llama-3.2-3B-Instruct, Category=Reward-Shaping Baselines2025.1241.257.6
Search-R1System=RL-based Agent2026.0340.3—
Router-R1System=RL-based Agent2026.0338.6—
RL w/o searchBase Model=Llama-3.2-3B-Instruct, Category=Outcome RL Baselines2025.1238.238.2
ADASEARCHBase Model=Qwen2.5-3B-Instruct, Category=Paper Method2025.1237.949
Naive ShapingBase Model=Qwen2.5-3B-Instruct, Category=Reward-Shaping Baselines2025.1237.841.6
Awareness ShapingBase Model=Qwen2.5-3B-Instruct, Category=Reward-Shaping Baselines2025.1237.745.9
GraphSearchSystem=Training-free Agent2026.0336.8—
HippoRAG2System=RAG-Based2026.0335.3—
Search-o1System=Training-free Agent2026.0334.8—
RAGBase Model=Qwen2.5-3B-Instruct, Category=Prompting Baselines2025.1231.70
LinearRAGSystem=RAG-Based2026.0330.2—
GraphRAGSystem=RAG-Based2026.0330.1—
RAGBase Model=Llama-3.2-3B-Instruct, Category=Prompting Baselines2025.1229.40
Vanilla RAGSystem=RAG-Based2026.0329.4—
CoTSystem=Basic LLM2026.0328.6—
RAPTORSystem=RAG-Based2026.0327.1—
HyperGraphRAGSystem=RAG-Based2026.0326.8—
Graph-R1System=RL-based Agent2026.0326.7—
CoTBase Model=Llama-3.2-3B-Instruct, Category=Prompting Baselines2025.122525
RL w/o searchBase Model=Qwen2.5-3B-Instruct, Category=Outcome RL Baselines2025.1221.721.7
Direct AnswerBase Model=Llama-3.2-3B-Instruct, Category=Prompting Baselines2025.1218.818.8
CoTBase Model=Qwen2.5-3B-Instruct, Category=Prompting Baselines2025.1214.114.1
Direct InferSystem=Basic LLM2026.0310.7—
Direct AnswerBase Model=Qwen2.5-3B-Instruct, Category=Prompting Baselines2025.128.18.1