Function Calling on Others (SealTools, OpenFunc, ToolAlpaca)
87.4Overall AccuracyST-Qwen2.5-14B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ST-Qwen2.5-14BSpeedup ratio=4.4×2026.02 | 87.4 | 99.7 | |
| ST-Qwen3-4BSpeedup ratio=3.9×2026.02 | 86.6 | 99.7 | |
| ST-Qwen2.5-7BSpeedup ratio=4.5×2026.02 | 86.2 | 99.5 | |
| ST-Qwen2.5-3BSpeedup ratio=3.8×2026.02 | 85.5 | 99.5 | |
| Qwen2.5-3BSpeedup ratio=1×2026.02 | 84.3 | 95.9 | |
| Qwen2.5-7BSpeedup ratio=1×2026.02 | 83.4 | 94.9 | |
| Qwen2.5-1.5BSpeedup ratio=1×2026.02 | 82.2 | 95.3 | |
| ST-Qwen2.5-0.5BSpeedup ratio=3.1×2026.02 | 82.2 | 99.1 | |
| Qwen3-4BSpeedup ratio=1×2026.02 | 82 | 91.8 | |
| Qwen2.5-0.5BSpeedup ratio=1×2026.02 | 80.9 | 95.2 | |
| ST-Qwen2.5-1.5BSpeedup ratio=3.5×2026.02 | 80.2 | 99.3 | |
| Qwen2.5-14BSpeedup ratio=1×2026.02 | 78.3 | 89.5 |