Tool Use on tool-use (test)
72AccuracyPBSD
Evaluation results
| Method | Links | |
|---|---|---|
| PBSDModel=Qwen3-8B2026.05 | 72 | |
| GRPOModel=Qwen3-8B2026.05 | 68.8 | |
| DAPOModel=Qwen3-8B2026.05 | 67.7 | |
| OPSDModel=Qwen3-8B2026.05 | 65.6 | |
| SDFTModel=Qwen3-8B2026.05 | 62.8 | |
| SRPOModel=Qwen3-8B2026.05 | 62.1 | |
| SFTModel=Qwen3-8B2026.05 | 61.7 | |
| Base (Instruct)Model=Qwen3-8B2026.05 | 61.3 | |
| PBSDModel=Qwen3-4B2026.05 | 60.6 | |
| GRPOModel=Qwen3-4B2026.05 | 58.9 | |
| OPSDModel=Qwen3-4B2026.05 | 53.9 | |
| SFTModel=Qwen3-4B2026.05 | 51.1 | |
| DAPOModel=Qwen3-4B2026.05 | 48.2 | |
| SRPOModel=Qwen3-4B2026.05 | 46.1 | |
| Base (Instruct)Model=Qwen3-4B2026.05 | 45.7 | |
| PBSDModel=Qwen3-1.7B2026.05 | 44.7 | |
| DAPOModel=Qwen3-1.7B2026.05 | 43.6 | |
| GRPOModel=Qwen3-1.7B2026.05 | 42.9 | |
| SDFTModel=Qwen3-4B2026.05 | 41.8 | |
| SFTModel=Qwen3-1.7B2026.05 | 39.7 | |
| SDFTModel=Qwen3-1.7B2026.05 | 38.3 | |
| OPSDModel=Qwen3-1.7B2026.05 | 37.2 | |
| Base (Instruct)Model=Qwen3-1.7B2026.05 | 36.9 | |
| SRPOModel=Qwen3-1.7B2026.05 | 36.9 |