Question Answering on HotpotQA (EM only)
42.4EMPiCA
Evaluation Results
| Method | Links | |
|---|---|---|
| PiCABackbone=Qwen2.5-7B Instruct2026.05 | 42.4 | |
| TIPSBackbone=Qwen2.5-7B Instruct2026.05 | 42.1 | |
| PiCABackbone=Qwen2.5-3B Instruct2026.05 | 40 | |
| StepSearchBackbone=Qwen2.5-7B Instruct2026.05 | 38.6 | |
| Search-R1Backbone=Qwen2.5-7B Instruct2026.05 | 37 | |
| StepSearchBackbone=Qwen2.5-3B Instruct2026.05 | 34.5 | |
| ZeroSearchBackbone=Qwen2.5-7B Instruct2026.05 | 32.5 | |
| Search-R1Backbone=Qwen2.5-3B Instruct2026.05 | 32.4 | |
| TIPSBackbone=Qwen2.5-3B Instruct2026.05 | 31.4 | |
| RAGBackbone=Qwen2.5-7B Instruct2026.05 | 28.7 | |
| ZeroSearchBackbone=Qwen2.5-3B Instruct2026.05 | 26.7 | |
| MT-PPOBackbone=Qwen2.5-7B Instruct2026.05 | 26.5 | |
| MT-PPOBackbone=Qwen2.5-3B Instruct2026.05 | 25.5 | |
| RAGBackbone=Qwen2.5-3B Instruct2026.05 | 25.1 | |
| Search-o1Backbone=Qwen2.5-3B Instruct2026.05 | 24 | |
| Search-o1Backbone=Qwen2.5-7B Instruct2026.05 | 19.3 |