Knowledge-intensive Reasoning on Musique
87AccuracyR1-Searcher
Evaluation Results
| Method | Links | |
|---|---|---|
| R1-SearcherCategory=RL-only TIR Methods2026.01 | 87 | |
| AutoTrajCategory=SFT-RL TIR Methods2026.01 | 86 | |
| AutoTIRCategory=RL-only TIR Methods2026.01 | 85 | |
| Qwen2.5-7B-InstructFramework=Multi-Dimensional Trajectory Evaluation2026.01 | 77 | |
| Vanilla SFT-RL TIRCategory=SFT-RL TIR Methods2026.01 | 77 | |
| ReSearchCategory=RL-only TIR Methods2026.01 | 76 | |
| Tool-Star-SFTCategory=SFT-only TIR Methods2026.01 | 73 | |
| ToRLCategory=RL-only TIR Methods2026.01 | 72 | |
| Tool-StarCategory=SFT-RL TIR Methods2026.01 | 63 | |
| APPOBackbone=Llama3.1-8B-Instruct2026.06 | 35.2 | |
| ARPOBackbone=Llama3.1-8B-Instruct2026.06 | 34.8 | |
| TEPOdenseBackbone=Llama3.1-8B-Instruct2026.02 | 33.4 | |
| TEPOdenseBackbone=Qwen2.5-7B-Instruct2026.02 | 32.2 | |
| CISPOBackbone=Llama3.1-8B-Instruct2026.06 | 32.2 | |
| GRPOBackbone=Llama3.1-8B-Instruct2026.02 | 32.1 | |
| GIGPOBackbone=Llama3.1-8B-Instruct2026.06 | 31.8 | |
| GRPOBackbone=Qwen2.5-7B-Instruct2026.02 | 31.7 | |
| GPPOBackbone=Qwen2.5-7B-Instruct2026.06 | 31.5 | |
| APPOBackbone=Qwen2.5-7B-Instruct2026.06 | 31.5 | |
| GIGPOBackbone=Qwen2.5-7B-Instruct2026.06 | 31.1 | |
| ARPOBackbone=Qwen2.5-7B-Instruct2026.06 | 31.1 | |
| AEPOBackbone=Qwen2.5-7B-Instruct2026.02 | 31 | |
| GRPOBackbone=Llama3.1-8B-Instruct2026.06 | 31 | |
| GRPOBackbone=Qwen2.5-7B-Instruct2026.06 | 30.6 | |
| SFTBackbone=Qwen2.5-7B-Instruct2026.02 | 30.2 | |
| TEPOsparseBackbone=Llama3.1-8B-Instruct2026.02 | 30.2 | |
| TEPOsparseBackbone=Qwen2.5-7B-Instruct2026.02 | 29.9 | |
| Reinforce++Backbone=Llama3.1-8B-Instruct2026.06 | 29.9 | |
| ARPOBackbone=Qwen2.5-7B-Instruct2026.02 | 29.83 | |
| GPPOBackbone=Llama3.1-8B-Instruct2026.06 | 29.8 | |
| ARPOBackbone=Llama3.1-8B-Instruct2026.02 | 29.2 | |
| DAPOBackbone=Llama3.1-8B-Instruct2026.06 | 29.2 | |
| CISPOBackbone=Qwen2.5-7B-Instruct2026.06 | 29.1 | |
| SFTBackbone=Llama3.1-8B-Instruct2026.02 | 29 | |
| DAPOBackbone=Qwen2.5-7B-Instruct2026.06 | 28.6 | |
| Reinforce++Backbone=Qwen2.5-7B-Instruct2026.06 | 25.2 | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct2026.02 | 19.2 | |
| Llama3.1-8B-InstructBackbone=Llama3.1-8B-Instruct2026.02 | 17.3 | |
| AutoTIRBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 17 | |
| TIR PromptingBackbone=Llama3.1-8B-Instruct2026.06 | 15.5 | |
| AutoTrajBackbone=Qwen2.5-7B, Training Paradigm=SFT–RL TIR, SFT Trajectory Count=13K2026.01 | 14.5 | |
| ReSearchBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 14 | |
| Vanilla SFT-RL TIRBackbone=Qwen2.5-7B, Training Paradigm=SFT–RL TIR2026.01 | 14 | |
| Tool-Star-SFTBackbone=Qwen2.5-7B, Training Paradigm=SFT-only, SFT Trajectory Count=54K2026.01 | 11 | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B, Training Paradigm=Instruct2026.01 | 10.5 | |
| Zero-shotBackbone=Llama3.1-8B-Instruct2026.06 | 10.4 | |
| TIR PromptingBackbone=Qwen2.5-7B-Instruct2026.06 | 9.5 | |
| Tool-StarBackbone=Qwen2.5-7B, Training Paradigm=SFT–RL TIR, SFT Trajectory Count=54K2026.01 | 9 | |
| R1-SearcherBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 8 | |
| Zero-shotBackbone=Qwen2.5-7B-Instruct2026.06 | 6.6 | |
| ToRLBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 2 |