Tool Use on Evaluation dataset
51.98AccuracyPORTool
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PORToolBackbone=Qwen-2.5-7B-Instruct2025.10 | 51.98 | 3.07 | 7.1 | 0.851 | |
| AgentFlowBackbone=Qwen-2.5-7B-Instruct2025.10 | 48.23 | 3.3 | 11.21 | 0.816 | |
| ARPOBackbone=Qwen-2.5-7B-Instruct2025.10 | 48.18 | 3.19 | 12.34 | 0.819 | |
| SimpleTIRBackbone=Qwen-2.5-7B-Instruct2025.10 | 47.62 | 3.12 | 10.47 | 0.832 | |
| GRPOfmBackbone=Qwen-2.5-7B-Instruct2025.10 | 47.58 | 3.18 | 11.52 | 0.826 | |
| PORToolBackbone=Qwen-3-1.7B2025.10 | 46.6 | 2.64 | 7.29 | 0.877 | |
| GRPOBackbone=Qwen-2.5-7B-Instruct2025.10 | 46.09 | 3.31 | 13.27 | 0.808 | |
| ToRLBackbone=Qwen-2.5-7B-Instruct2025.10 | 45.52 | 3.2 | 12.33 | 0.814 | |
| ARPOfmBackbone=Qwen-2.5-7B-Instruct2025.10 | 44.97 | 3.16 | 11.56 | 0.827 | |
| DAPOBackbone=Qwen-2.5-7B-Instruct2025.10 | 43.51 | 3.37 | 14.58 | 0.79 | |
| GRPOfmBackbone=Qwen-3-1.7B2025.10 | 42.76 | 2.79 | 9.91 | 0.857 | |
| SimpleTIRBackbone=Qwen-3-1.7B2025.10 | 41.76 | 2.82 | 11.03 | 0.884 | |
| ToRLBackbone=Qwen-3-1.7B2025.10 | 41.73 | 2.94 | 11.4 | 0.81 | |
| DAPOBackbone=Qwen-3-1.7B2025.10 | 39.47 | 3.08 | 11.96 | 0.793 | |
| ARPOBackbone=Qwen-3-1.7B2025.10 | 39.27 | 3.07 | 11.96 | 0.784 | |
| GRPOBackbone=Qwen-3-1.7B2025.10 | 39.08 | 2.96 | 10.65 | 0.834 | |
| AgentFlowBackbone=Qwen-3-1.7B2025.10 | 37.2 | 3.21 | 13.27 | 0.767 | |
| ARPOfmBackbone=Qwen-3-1.7B2025.10 | 34.56 | 3.21 | 11.03 | 0.808 | |
| PromptingBackbone=Qwen-2.5-7B-Instruct2025.10 | 24.36 | 4.76 | 58.5 | 0.466 | |
| PromptingBackbone=Qwen-3-1.7B2025.10 | 12.06 | 5.5 | 83.92 | 0.322 |