Tool-use on BFCL Multi-turn
54.75AccuracyClaude-Sonnet-4
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Claude-Sonnet-4Category=Proprietary Models2026.02 | 54.75 | 55.91 | — | — | — | — | |
| AWPOParameter=4B2025.12 | 52.12 | — | 59 | 59 | 39 | 51.5 | |
| DeepSeek-V3.2Category=Open-Source Foundation Models2026.02 | 44.88 | 69.75 | — | — | — | — | |
| DeepSeek-R1-0528Parameter=671B2025.12 | 44.5 | — | 54.5 | 41 | 36.5 | 46 | |
| GPT-5Category=Proprietary Models2026.02 | 43.75 | 68.69 | — | — | — | — | |
| Moonshotai-Kimi-K2-InstParameter=1000B2025.12 | 41.25 | — | 51 | 43 | 31 | 40 | |
| TDScalingBase Model=Qwen3-Coder-30B-A3B-Instruct, Training Samples=50002026.02 | 40.44 | 52.47 | — | — | — | — | |
| Qwen3-235B-A22BParameter=235B2025.12 | 40.12 | — | 49 | 41 | 29.5 | 41 | |
| GPT-4.1Category=Proprietary Models2026.02 | 38.88 | 50.72 | — | — | — | — | |
| watt-tool-8BParameter=8B2025.12 | 37.88 | — | 45.5 | 39 | 24 | 43 | |
| BitAgent-8BParameter=8B2025.12 | 37.75 | — | 46.5 | 37.5 | 24 | 43 | |
| TOUCANCategory=Tool-Learning Methods, Training Samples=50002026.02 | 37.03 | 45.92 | — | — | — | — | |
| ToolACE-2-8BParameter=8B2025.12 | 37 | — | 47 | 31 | 28 | 42 | |
| TDScalingBase Model=Qwen3-Coder-30B-A3B-Instruct, Training Samples=5002026.02 | 36.66 | 48.99 | — | — | — | — | |
| TDScalingBase Model=Qwen3-30B-A3B-Instruct, Training Samples=5002026.02 | 36.63 | 41.5 | — | — | — | — | |
| Grok-4-0709Parameter=/2025.12 | 36.12 | — | 44 | 31 | 26 | 43.5 | |
| Qwen3-Coder-480B-A35B-InstructCategory=Open-Source Foundation Models2026.02 | 35.91 | 51.85 | — | — | — | — | |
| Qwen3-30B-A3B-InstructCategory=Base Model2026.02 | 33.22 | 34.74 | — | — | — | — | |
| Qwen3-Coder-30B-A3B-InstructCategory=Base Model2026.02 | 29.41 | 41.48 | — | — | — | — | |
| Gemini-2.5-proCategory=Proprietary Models2026.02 | 29.25 | 44.99 | — | — | — | — | |
| GPT-5-2025-08-07Parameter=/2025.12 | 28.5 | — | 33.5 | 29.5 | 23 | 28 | |
| APIGen-MTCategory=Tool-Learning Methods, Training Samples=50002026.02 | 27.25 | 42.81 | — | — | — | — | |
| Gemini-2.5-ProParameter=/2025.12 | 25 | — | 25.5 | 26 | 24.5 | 24 | |
| SimiaCategory=Tool-Learning Methods, Training Samples=50002026.02 | 23.22 | 45.29 | — | — | — | — |