General Question Answering on NQ (Natural Questions) in-domain (val/test)
50.9Exact MatchSearch-R2
Evaluation results
| Method | Links | |
|---|---|---|
| Search-R2Backbone=Qwen2.5-32B2026.02 | 50.9 | |
| RECONBackbone=Qwen2.5-7B-Base, Training Protocol=PPO, RECON Stage=Stage 1 + Stage 22025.10 | 49.3 | |
| Search-R1Backbone=Qwen2.5-7B-Base, Training Protocol=PPO2025.10 | 48 | |
| Search-R2Backbone=Qwen3-8B2026.02 | 47.7 | |
| Search-R1Backbone=Qwen2.5-32B2026.02 | 47.6 | |
| Search-R1Backbone=Qwen3-8B2026.02 | 44 | |
| RECONBackbone=Qwen2.5-3B-Base, Training Protocol=PPO, RECON Stage=Stage 1 + Stage 22025.10 | 44 | |
| Search-R1Backbone=Qwen2.5-3B-Base, Training Protocol=PPO2025.10 | 40.6 | |
| RECONBackbone=Qwen2.5-3B-Base, Training Protocol=PPO, RECON Stage=Stage 2 Distillation-only2025.10 | 40 | |
| Search-R2Backbone=Qwen2.5-7B2026.02 | 39.9 | |
| Search-R1Backbone=Qwen2.5-7B2026.02 | 39.5 | |
| Rejection SamplingBackbone=Qwen2.5-7B2026.02 | 36 | |
| Rejection Sampling2025.10 | 36 | |
| RAGBackbone=Qwen2.5-7B2026.02 | 34.9 | |
| RAG2025.10 | 34.9 | |
| SFTBackbone=Qwen2.5-7B2026.02 | 31.8 | |
| SFT2025.10 | 31.8 | |
| R1-baseBackbone=Qwen2.5-7B2026.02 | 29.7 | |
| R1-base2025.10 | 29.7 | |
| RECONBackbone=Qwen2.5-7B-Base, Training Protocol=PPO, RECON Stage=Stage 2 Distillation-only2025.10 | 29.6 | |
| R1-instructBackbone=Qwen2.5-7B2026.02 | 27 | |
| R1-instruct2025.10 | 27 | |
| IRCoTBackbone=Qwen2.5-7B2026.02 | 22.4 | |
| IRCoT2025.10 | 22.4 | |
| Search-o1Backbone=Qwen2.5-7B2026.02 | 15.1 | |
| Search-o12025.10 | 15.1 | |
| Direct InferenceBackbone=Qwen2.5-7B2026.02 | 13.4 | |
| Direct Inference2025.10 | 13.4 | |
| CoTBackbone=Qwen2.5-7B2026.02 | 4.8 | |
| CoT2025.10 | 4.8 |