Question Answering on NQ, TriviaQA, PopQA (test)
51.3Overall Average ScoreDART
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DARTBackbone=Qwen2.5-3b-Base2026.02 | 51.3 | 45.7 | 60.5 | 47.8 | — | |
| DARTBackbone=Qwen2.5-3b-Instruct2026.02 | 51 | 45.1 | 60.2 | 47.6 | — | |
| Search-R1-GRPOBackbone=Qwen2.5-3b-Base2026.02 | 47.8 | 44 | 58.2 | 41.3 | — | |
| Search-R1-PPO-BaseBackbone=Qwen2.5-3b-Base2026.02 | 47.6 | 40.6 | 58.7 | 43.5 | — | |
| Search-R1-GRPOBackbone=Qwen2.5-3b-Instruct2026.02 | 45.1 | 39.7 | 56.5 | 39.1 | — | |
| LLDSBackbone=Qwen2.5-3b-Instruct, Base Training=Search-R1-GSPO2025.12 | 45.1 | 48.9 | 64 | 48.3 | 53.7 | |
| LLDSBackbone=Qwen2.5-3b-Instruct, Base Training=Search-R1-GRPO2025.12 | 44.1 | 46.2 | 62.7 | 46.8 | 51.9 | |
| LLDS-MABackbone=Qwen2.5-3b-Base, Base Training=Search-R1-GRPO2025.12 | 44 | 48.3 | 63.3 | 47.4 | 53 | |
| RAGBackbone=Qwen2.5-3B2026.02 | 42.6 | 34.8 | 54.4 | 38.7 | — | |
| Tree-GRPOBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 42.4 | 46.8 | 59.7 | 43.6 | 50 | |
| Search-R1-PPO-InsBackbone=Qwen2.5-3b-Instruct2026.02 | 42.1 | 34.1 | 54.5 | 37.8 | — | |
| DARTBackbone=Qwen2.5-3b-Base2026.02 | 40.5 | — | — | — | — | |
| DARTBackbone=Qwen2.5-3b-Instruct2026.02 | 39.9 | — | — | — | — | |
| Rejection SamplingBackbone=Qwen2.5-3B2026.02 | 37.1 | 29.4 | 48.8 | 33.2 | — | |
| LLDSBackbone=Qwen2.5-3b-Base, Base Training=Search-R1-GRPO2025.12 | 36 | 47.9 | 62.7 | 45.3 | 52 | |
| ZeroSearch-BaseBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 34.5 | 43 | 61.6 | 41.4 | 48.7 | |
| Search-R1-GRPOBackbone=Qwen2.5-3b-Instruct2026.02 | 33.6 | — | — | — | — | |
| Search-R1-GRPOBackbone=Qwen2.5-3b-Instruct2025.12 | 33.6 | 39.7 | 56.5 | 39.1 | 45.1 | |
| Search-R1-GSPOBackbone=Qwen2.5-3b-Instruct2025.12 | 33.1 | 37.6 | 56.1 | 37.4 | 43.7 | |
| Search-R1-PPO-InsBackbone=Qwen2.5-3b-Instruct2026.02 | 32.5 | — | — | — | — | |
| Search-R1-PPO-InsBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 32.5 | 34.1 | 54.5 | 37.8 | 42.1 | |
| Search-o1Backbone=Qwen2.5-3B2026.02 | 32.4 | 23.8 | 47.2 | 26.2 | — | |
| ZeroSearch-InsBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 31.7 | 41.4 | 57.4 | 44.8 | 47.9 | |
| Search-R1-GRPOBackbone=Qwen2.5-3b-Base2025.12 | 31.2 | 42.1 | 58.3 | 41.3 | 47.2 | |
| StepSearchBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 31.1 | 29.6 | 49 | 34.1 | 37.5 | |
| Search-R1-PPO-BaseBackbone=Qwen2.5-3b-Base2026.02 | 30.3 | — | — | — | — | |
| Search-R1-GRPOBackbone=Qwen2.5-3b-Base2026.02 | 30.3 | — | — | — | — | |
| Search-R1-PPO-BaseBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 30.3 | 40.6 | 58.7 | 43.5 | 47.6 | |
| R1-baseBackbone=Qwen2.5-3b-Base2026.02 | 28.5 | 22.6 | 45.5 | 17.3 | — | |
| R1-instructBackbone=Qwen2.5-3b-Instruct2026.02 | 27.7 | 21 | 44.9 | 17.1 | — | |
| RAGBackbone=Qwen2.5-3B2026.02 | 27 | — | — | — | — | |
| RAGBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 27 | 34.8 | 54.4 | 38.7 | 42.6 | |
| Rejection SamplingBackbone=Qwen2.5-3B2026.02 | 26.5 | — | — | — | — | |
| Rejection SamplingBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 26.5 | 29.4 | 48.8 | 33.2 | 37.1 | |
| Search-o1Backbone=Qwen2.5-3B2026.02 | 25.5 | — | — | — | — | |
| Search-o1Backbone=Qwen2.5-3b-Base/Instruct2025.12 | 25.5 | 23.8 | 47.2 | 26.2 | 32.4 | |
| R1-baseBackbone=Qwen2.5-3b-Base2026.02 | 22.9 | — | — | — | — | |
| R1-baseBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 22.9 | 22.6 | 45.5 | 17.3 | 28.5 | |
| R1-instructBackbone=Qwen2.5-3b-Instruct2026.02 | 22.4 | — | — | — | — | |
| R1-instructBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 22.4 | 21 | 44.9 | 17.1 | 27.7 | |
| SFTBackbone=Qwen2.5-3B2026.02 | 21.5 | 24.9 | 29.2 | 10.4 | — | |
| IRCoTBackbone=Qwen2.5-3B2026.02 | 20.8 | 11.1 | 31.2 | 20 | — | |
| IRCoTBackbone=Qwen2.5-3B2026.02 | 18.1 | — | — | — | — | |
| SFTBackbone=Qwen2.5-3B2026.02 | 17.6 | — | — | — | — | |
| Direct InferenceBackbone=Qwen2.5-3B2026.02 | 16.7 | 10.6 | 28.8 | 10.8 | — | |
| Direct InferenceBackbone=Qwen2.5-3B2026.02 | 13.4 | — | — | — | — | |
| Direct InferenceBackbone=Qwen2.5-3b-Base/Instruct2025.12 | 13.4 | 10.6 | 28.8 | 10.8 | 16.7 | |
| CoTBackbone=Qwen2.5-3B2026.02 | 2 | 2.3 | 3.2 | 0.5 | — | |
| CoTBackbone=Qwen2.5-3B2026.02 | 1.5 | — | — | — | — |