Multi-Hop Question Answering on HotpotQA (EM, F1, SD, SE)
47.1Exact Match (EM)SD-Search-Instruct
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SD-Search-InstructTraining Pipeline=Pure RL, External Teacher=None, Backbone=Qwen2.5-7B2026.05 | 47.1 | — | — | — | |
| MR-Search-BaseTraining Pipeline=Pure RL, External Teacher=None, Backbone=Qwen2.5-7B2026.05 | 46.8 | — | — | — | |
| SD-Search-BaseTraining Pipeline=Pure RL, External Teacher=None, Backbone=Qwen2.5-7B2026.05 | 46.8 | — | — | — | |
| AutoRefine-BaseTraining Pipeline=Pure RL, External Teacher=None, Backbone=Qwen2.5-7B2026.05 | 45.1 | — | — | — | |
| MultiSearchBackbone=Qwen2.5-7B, Model Variant=Base2026.05 | 44.6 | — | — | — | |
| AutoRefineBackbone=Qwen2.5-7B, Model Variant=Base2026.05 | 44.5 | — | — | — | |
| CriticSearchBackbone=Qwen2.5-7B2026.05 | 44.2 | — | — | — | |
| Search-R1-baseBackbone=Qwen2.5-7B2026.04 | 43.7 | 55.4 | 2.65 | 16.5 | |
| MultiSearchBackbone=Qwen2.5-3B, Model Variant=Base2026.05 | 43.1 | — | — | — | |
| AutoSearchBackbone=Qwen2.5-7B2026.04 | 42.7 | 54.2 | 1.34 | 31.2 | |
| MultiSearchBackbone=Qwen2.5-7B, Model Variant=Instruct2026.05 | 42.1 | — | — | — | |
| Thinker-InstructTraining Pipeline=Synthesize → SFT, External Teacher=Qwen2.5-72B, Backbone=Qwen2.5-7B2026.05 | 42.1 | — | — | — | |
| MultiSearchBackbone=Qwen2.5-3B, Model Variant=Instruct2026.05 | 42 | — | — | — | |
| CriticSearchBackbone=Qwen2.5-3B2026.05 | 41.4 | — | — | — | |
| Search-R1-BaseTraining Pipeline=Pure RL, External Teacher=None, Backbone=Qwen2.5-7B2026.05 | 41 | — | — | — | |
| AutoRefineBackbone=Qwen2.5-7B, Model Variant=Instruct2026.05 | 40.8 | — | — | — | |
| AutoRefineBackbone=Qwen2.5-3B, Model Variant=Base2026.05 | 40.5 | — | — | — | |
| AutoRefineBackbone=Qwen2.5-3B, Model Variant=Instruct2026.05 | 40.4 | — | — | — | |
| AutoSearchBackbone=Qwen2.5-3B2026.04 | 39.4 | 50.5 | 1.49 | 26.5 | |
| StepSearch-instructBackbone=Qwen2.5-7B2026.04 | 38.9 | 50.4 | 2.1 | 18.6 | |
| Search-R1-instructBackbone=Qwen2.5-7B2026.04 | 38.7 | 49 | 2.43 | 15.9 | |
| Search-R1Backbone=Qwen2.5-7B, Model Variant=Instruct2026.05 | 38.6 | — | — | — | |
| StepSearchBackbone=Qwen2.5-7B, Model Variant=Instruct2026.05 | 38.6 | — | — | — | |
| StepSearch-InstructTraining Pipeline=Pure RL, External Teacher=GPT-4o, Backbone=Qwen2.5-7B2026.05 | 38.6 | — | — | — | |
| ReasonRAGBackbone=Qwen2.5-7B2026.05 | 38.4 | — | — | — | |
| StepSearchBackbone=Qwen2.5-7B, Model Variant=Base2026.05 | 38 | — | — | — | |
| StepSearch-BaseTraining Pipeline=Pure RL, External Teacher=GPT-4o, Backbone=Qwen2.5-7B2026.05 | 38 | — | — | — | |
| StepSearch-baseBackbone=Qwen2.5-7B2026.04 | 37 | 48.6 | 2.07 | 17.8 | |
| Search-R1-InstructTraining Pipeline=Pure RL, External Teacher=None, Backbone=Qwen2.5-7B2026.05 | 37 | — | — | — | |
| Dr.ZeroBackbone=Qwen2.5-7B2026.05 | 36.2 | — | — | — | |
| ReSearchBackbone=Qwen2.5-3B, Model Variant=Instruct2026.05 | 35.1 | — | — | — | |
| StepSearchBackbone=Qwen2.5-3B, Model Variant=Instruct2026.05 | 34.5 | — | — | — | |
| ZeroSearchBackbone=Qwen2.5-7B, Model Variant=Base2026.05 | 33.8 | — | — | — | |
| AdaSearchBackbone=Qwen2.5-3B2026.05 | 33.4 | — | — | — | |
| StepSearch-instructBackbone=Qwen2.5-3B2026.04 | 33.2 | 44.2 | 2.05 | 16.2 | |
| Search-R1Backbone=Qwen2.5-3B, Model Variant=Instruct2026.05 | 33.1 | — | — | — | |
| StepSearchBackbone=Qwen2.5-3B, Model Variant=Base2026.05 | 32.9 | — | — | — | |
| Search-R1Backbone=Qwen2.5-7B, Model Variant=Base2026.05 | 32.6 | — | — | — | |
| ZeroSearchBackbone=Qwen2.5-3B, Model Variant=Base2026.05 | 32.2 | — | — | — | |
| StepSearch-baseBackbone=Qwen2.5-3B2026.04 | 32.1 | 42.6 | 3.19 | 10.1 | |
| HIPRAG-instructBackbone=Qwen2.5-7B2026.04 | 30.5 | 42.7 | 1.55 | 19.7 | |
| ReSearchBackbone=Qwen2.5-3B, Model Variant=Base2026.05 | 30.5 | — | — | — | |
| Search-R1-instructBackbone=Qwen2.5-3B2026.04 | 30.3 | 39.6 | 2.09 | 14.5 | |
| RAGBackbone=Qwen2.5-7B2026.05 | 29.9 | — | — | — | |
| Dr.ZeroBackbone=Qwen2.5-3B2026.05 | 29.8 | — | — | — | |
| Search-R1Backbone=Qwen2.5-3B, Model Variant=Base2026.05 | 29.7 | — | — | — | |
| Search-R1-baseBackbone=Qwen2.5-3B2026.04 | 27.9 | 36.7 | 1.63 | 17.2 | |
| ZeroSearchBackbone=Qwen2.5-7B, Model Variant=Instruct2026.05 | 27.4 | — | — | — | |
| RAGBackbone=Qwen2.5-3B2026.05 | 25.5 | — | — | — | |
| R1Backbone=Qwen2.5-7B, Model Variant=Base2026.05 | 24.2 | — | — | — | |
| R1Backbone=Qwen2.5-7B, Model Variant=Instruct2026.05 | 23.7 | — | — | — | |
| ZeroSearchBackbone=Qwen2.5-3B, Model Variant=Instruct2026.05 | 22.8 | — | — | — | |
| Search-o1Backbone=Qwen2.5-3B2026.05 | 22.1 | — | — | — | |
| SFTBackbone=Qwen2.5-7B2026.05 | 21.7 | — | — | — | |
| R1Backbone=Qwen2.5-3B, Model Variant=Instruct2026.05 | 20.8 | — | — | — | |
| R1Backbone=Qwen2.5-3B, Model Variant=Base2026.05 | 20.1 | — | — | — | |
| Search-o1Backbone=Qwen2.5-7B2026.05 | 18.7 | — | — | — | |
| SFTBackbone=Qwen2.5-3B2026.05 | 18.6 | — | — | — | |
| Direct InferenceBackbone=Qwen2.5-7B2026.05 | 18.3 | — | — | — | |
| IRCoTBackbone=Qwen2.5-3B2026.05 | 16.4 | — | — | — | |
| Direct GenerationBackbone=Qwen2.5-3B2026.05 | 14.9 | — | — | — | |
| IRCoTBackbone=Qwen2.5-7B2026.05 | 13.3 | — | — | — | |
| HIPRAG-baseBackbone=Qwen2.5-3B2026.04 | 10.3 | 19.1 | 1.66 | 6.22 | |
| HIPRAG-instructBackbone=Qwen2.5-3B2026.04 | 10.1 | 18.4 | 1.58 | 6.4 | |
| CoTBackbone=Qwen2.5-7B2026.05 | 9.2 | — | — | — | |
| CoTBackbone=Qwen2.5-3B2026.05 | 2.1 | — | — | — |