Multi-turn Tool-use on FTRL
42.41Solve Rate (R)PACT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PACTBackbone=Qwen3-4B2026.06 | 42.41 | 34.69 | 36.6 | |
| SFT→MatchTIRBackbone=Qwen3-4B2026.06 | 37.17 | 30.4 | 32.03 | |
| MatchTIRBackbone=Qwen3-4B2026.06 | 36.1 | 30.6 | 31.6 | |
| GRPOBackbone=Qwen3-4B2026.06 | 33.12 | 31.8 | 30.84 | |
| CHORDBackbone=Qwen3-4B2026.06 | 32.69 | 29.84 | 29.88 | |
| ToolRLBackbone=Qwen3-4B2026.06 | 32.59 | 28.98 | 28.28 | |
| VanillaBackbone=Qwen3-4B2026.06 | 32.14 | 31.66 | 28.6 | |
| FTRLBackbone=Qwen3-4B2026.06 | 31.98 | 33.24 | 31.34 | |
| PACTBackbone=Qwen3-1.7B2026.06 | 28.33 | 26.94 | 22.93 | |
| SFTBackbone=Qwen3-4B2026.06 | 28.19 | 29.32 | 24.67 | |
| MatchTIRBackbone=Qwen3-1.7B2026.06 | 24.12 | 21.5 | 21.43 | |
| SFT→MatchTIRBackbone=Qwen3-1.7B2026.06 | 23.39 | 19.64 | 19.72 | |
| ToolRLBackbone=Qwen3-1.7B2026.06 | 22.79 | 17.93 | 17.99 | |
| FTRLBackbone=Qwen3-1.7B2026.06 | 22.78 | 22.06 | 21.06 | |
| CHORDBackbone=Qwen3-1.7B2026.06 | 22.68 | 19.14 | 18.5 | |
| SFTBackbone=Qwen3-1.7B2026.06 | 22.36 | 17.89 | 17.66 | |
| VanillaBackbone=Qwen3-1.7B2026.06 | 21.66 | 20.78 | 19.72 | |
| GRPOBackbone=Qwen3-1.7B2026.06 | 21.57 | 17.37 | 18.13 |