Tool-use interaction evaluation on FTRL
36.33Solve PMatchTIR (KM)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MatchTIR (KM)Backbone=Qwen3-8B2026.01 | 36.33 | 44.18 | 37.33 | 39.28 | |
| FTRL-MBackbone=Qwen3-4B2026.01 | 34.47 | 35.44 | 33.5 | 34.47 | |
| FTRL-SBackbone=Qwen3-4B2026.01 | 34.1 | 34.07 | 31.54 | 33.24 | |
| MatchTIR (OT)Backbone=Qwen3-8B2026.01 | 33.61 | 42.56 | 33.61 | 36.59 | |
| FTRL-MBackbone=Qwen3-8B2026.01 | 33.28 | 40.6 | 34.2 | 36.03 | |
| MatchTIR (KM)Backbone=Qwen3-4B2026.01 | 32.39 | 39.7 | 34.21 | 35.43 | |
| FTRL-SBackbone=Qwen3-8B2026.01 | 32.32 | 38.87 | 32.85 | 34.68 | |
| MatchTIR (OT)Backbone=Qwen3-4B2026.01 | 31.79 | 37.52 | 32.6 | 33.97 | |
| GRPOBackbone=Qwen3-8B2026.01 | 31.59 | 39.75 | 32.54 | 34.63 | |
| GRPOBackbone=Qwen3-4B2026.01 | 31.13 | 32.83 | 30.67 | 31.54 | |
| ToolRL-MBackbone=Qwen3-4B2026.01 | 30.9 | 36.26 | 32.28 | 33.15 | |
| VanillaBackbone=Qwen3-4B2026.01 | 30.78 | 29.65 | 25.85 | 28.76 | |
| ToolRL-MBackbone=Qwen3-8B2026.01 | 30.64 | 40.07 | 32.51 | 34.41 | |
| ToolRL-SBackbone=Qwen3-4B2026.01 | 28.26 | 28.32 | 23.78 | 26.79 | |
| VanillaBackbone=Qwen3-8B2026.01 | 28.08 | 36.55 | 29.74 | 31.46 | |
| ToolRL-SBackbone=Qwen3-8B2026.01 | 25.57 | 35.31 | 26.72 | 29.2 |