Question Answering on FRAMES out-domain (test)
31.31LasJD2PLAN-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| D2PLAN-7BBase LLM=Qwen2.5-7B-Instruct2026.01 | 31.31 | 18.08 | |
| D2PLAN-3BBase LLM=Qwen2.5-3B-Instruct2026.01 | 25.97 | 14.68 | |
| R1-SearcherBase LLM=Qwen2.5-7B-Instruct2026.01 | 25.61 | 14.32 | |
| ReSearchBase LLM=Qwen2.5-7B-Instruct2026.01 | 24.27 | 14.32 | |
| AutoRefineBase LLM=Qwen2.5-3B-Instruct2026.01 | 23.79 | 11.17 | |
| StepSearchBase LLM=Qwen2.5-7B-Instruct2026.01 | 23.18 | 13.23 | |
| Search-R1Base LLM=Qwen2.5-7B-Instruct2026.01 | 19.78 | 10.19 | |
| ZeroSearchBase LLM=Qwen2.5-7B-Instruct2026.01 | 18.33 | 10.07 | |
| Search-R1Base LLM=Qwen2.5-3B-Instruct2026.01 | 18.2 | 4.85 | |
| StepSearchBase LLM=Qwen2.5-3B-Instruct2026.01 | 13.83 | 6.55 | |
| ZeroSearchBase LLM=Qwen2.5-3B-Instruct2026.01 | 10.32 | 4 |