Monolingual Question Answering on HOTPOTQA (fEM, c3Recall)
44.14fEMSearch-R1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Search-R1Backbone=Qwen2.5-7B-Instruct, Paradigm=Post-training2026.04 | 44.14 | 67.17 | |
| CroSearch-R1Backbone=Qwen2.5-7B-Instruct, Paradigm=Post-training2026.04 | 44.14 | 67.7 | |
| SFTBackbone=Qwen2.5-7B-Instruct, Paradigm=Post-training2026.04 | 43 | 54.61 | |
| IRCoTBackbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 40.84 | 47.67 | |
| SFTBackbone=Qwen2.5-3B-Instruct, Paradigm=Post-training2026.04 | 39.2 | 50.79 | |
| CroSearch-R1Backbone=Qwen2.5-3B-Instruct, Paradigm=Post-training2026.04 | 38.67 | 66.88 | |
| RAGBackbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 37.6 | 50.34 | |
| Search-o1Backbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 36.32 | 47.62 | |
| IRCoTBackbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 35.42 | 42.7 | |
| Search-R1Backbone=Qwen2.5-3B-Instruct, Paradigm=Post-training2026.04 | 35.35 | 62.65 | |
| RAGBackbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 31.5 | 43.84 | |
| Search-o1Backbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 30.44 | 41.68 | |
| Direct InferenceBackbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 26.5 | 43.83 | |
| Direct InferenceBackbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 19.6 | 35.97 |