Single-hop Question Answering on PopQA (test)
51.5AccuracyZeroSearch
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ZeroSearchType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 51.5 | — | |
| ZeroSearchBackbone=Qwen2.5-7B-Instruct, Type=Outcome RL2026.07 | 51.5 | — | |
| STAPOBackbone=Qwen2.5-7B-Instruct, Type=Process RL2026.07 | 48.7 | — | |
| GRPO w/ PaWType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 48.5 | — | |
| GRPOType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 47.8 | — | |
| GRPO w/ PaWType=RL Training, Backbone=Qwen2.5-3B-Instruct2026.06 | 47.5 | — | |
| GIGPO w/ PaWType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 47.2 | — | |
| GIGPO w/ PaWType=RL Training, Backbone=Qwen2.5-3B-Instruct2026.06 | 46.7 | — | |
| GIGPOType=RL Training, Backbone=Qwen2.5-3B-Instruct2026.06 | 46.3 | — | |
| GRPOType=RL Training, Backbone=Qwen2.5-3B-Instruct2026.06 | 46.1 | — | |
| GiGPOBackbone=Qwen2.5-7B-Instruct, Type=Process RL2026.07 | 46.1 | — | |
| GIGPOType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 46 | — | |
| STAPOBackbone=Qwen2.5-3B-Instruct, Type=Process RL2026.07 | 45.8 | — | |
| ZeroSearchType=RL Training, Backbone=Qwen2.5-3B-Instruct2026.06 | 44.8 | — | |
| ZeroSearchBackbone=Qwen2.5-3B-Instruct, Type=Outcome RL2026.07 | 44.8 | — | |
| InfoReasoner-3BRetrieval=true, Model Scale=3B2026.01 | 44.2 | — | |
| GiGPOBackbone=Qwen2.5-3B-Instruct, Type=Process RL2026.07 | 42.4 | — | |
| InfoReasoner-7BRetrieval=true, Model Scale=7B2026.01 | 41.6 | — | |
| AutoRefine-7B-BaseRetrieval=true, Model Scale=7B2026.01 | 40.2 | — | |
| Search-R1Type=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 39.7 | — | |
| Search-R1Backbone=Qwen2.5-7B-Instruct, Type=Outcome RL2026.07 | 39.7 | — | |
| Search-R1-3B-BaseRetrieval=true, Model Scale=3B2026.01 | 39 | — | |
| Search-R1-7B-InstructRetrieval=true, Model Scale=7B2026.01 | 39 | — | |
| RAGRetrieval=true, Model Scale=3B2026.01 | 38.7 | — | |
| Search-R1Type=RL Training, Backbone=Qwen2.5-3B-Instruct2026.06 | 37.8 | — | |
| Search-R1Backbone=Qwen2.5-3B-Instruct, Type=Outcome RL2026.07 | 37.8 | — | |
| InForge-3BRetrieval=true, Model Scale=3B2026.01 | 37.4 | — | |
| Search-R1-7B-BaseRetrieval=true, Model Scale=7B2026.01 | 36.4 | — | |
| Search-R1-3B-InstructRetrieval=true, Model Scale=3B2026.01 | 35.4 | — | |
| ReSearch-7B-InstructRetrieval=true, Model Scale=7B2026.01 | 35.4 | — | |
| ReasonRAG-7BRetrieval=true, Model Scale=7B2026.01 | 34.8 | — | |
| AutoRefine-3B-InstructRetrieval=true, Model Scale=3B2026.01 | 34.4 | — | |
| AutoRefine-3B-BaseRetrieval=true, Model Scale=3B2026.01 | 27.2 | — | |
| ReSearch-7B-BaseRetrieval=true, Model Scale=7B2026.01 | 27 | — | |
| Search-o1Retrieval=true, Model Scale=3B2026.01 | 26.2 | — | |
| IRCoTRetrieval=true, Model Scale=3B2026.01 | 20 | — | |
| R1-InstructBackbone=Qwen2.5-7B-Instruct, Type=Outcome RL2026.07 | 19.9 | — | |
| R1-BaseRetrieval=false2026.01 | 17.3 | — | |
| R1-InstructRetrieval=false2026.01 | 17.1 | — | |
| R1-InstructBackbone=Qwen2.5-3B-Instruct, Type=Outcome RL2026.07 | 17.1 | — | |
| Direct GenerationRetrieval=false2026.01 | 10.8 | — | |
| SFTRetrieval=false2026.01 | 10.4 | — | |
| CoTRetrieval=false2026.01 | 5.4 | — | |
| GiGPOBase Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 49.1 | |
| GRPOBase Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 50 | |
| GSPOBase Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 50.6 | |
| MetaRLBase Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 49.8 | |
| PivoARLBase Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 59.4 | |
| Search-R1Base Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 48.9 | |
| StepSearchBase Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 47.9 | |
| ZeroSearchBase Model=Qwen3-4B, Search-augmented=true, Domain=Out-of-domain2026.07 | — | 48.3 |