Function Calling on BFCL Exec v3
94.6Overall AccuracyQwen3-4B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-4BSpeedup ratio=1×2026.02 | 94.6 | 97.3 | |
| Qwen2.5-7BSpeedup ratio=1×2026.02 | 94 | 99.3 | |
| Qwen2.5-14BSpeedup ratio=1×2026.02 | 94 | 98.7 | |
| ST-Qwen2.5-7BSpeedup ratio=4.5×2026.02 | 92.6 | 100 | |
| Qwen2.5-1.5BSpeedup ratio=1×2026.02 | 91.9 | 98 | |
| ST-Qwen2.5-3BSpeedup ratio=3.8×2026.02 | 91.3 | 100 | |
| ST-Qwen2.5-14BSpeedup ratio=4.4×2026.02 | 91.3 | 100 | |
| ST-Qwen2.5-1.5BSpeedup ratio=3.5×2026.02 | 90.6 | 100 | |
| ST-Qwen3-4BSpeedup ratio=3.9×2026.02 | 89.9 | 100 | |
| Qwen2.5-0.5BSpeedup ratio=1×2026.02 | 88.6 | 96.6 | |
| ST-Qwen2.5-0.5BSpeedup ratio=3.1×2026.02 | 87.9 | 100 | |
| Qwen2.5-3BSpeedup ratio=1×2026.02 | 86.6 | 96 |