Function Calling on ACEBench Normal
75.6AccuracyWatt-Tool
Evaluation results
| Method | Links | |
|---|---|---|
| Watt-ToolParameters=8B2026.02 | 75.6 | |
| STARParameters=4B2026.02 | 74.1 | |
| Qwen3Parameters=8B2026.02 | 72.9 | |
| TeacherParameters=8B2026.02 | 72.7 | |
| Qwen3Parameters=4B2026.02 | 71.8 | |
| Hammer2.1Parameters=7B2026.02 | 62.8 | |
| STARParameters=1.7B2026.02 | 60.9 | |
| STARParameters=0.6B2026.02 | 53 | |
| Qwen3Parameters=1.7B2026.02 | 51.6 | |
| Llama3.1Parameters=8B2026.02 | 46.6 | |
| Llama3.2Parameters=3B2026.02 | 29.6 | |
| Qwen3Parameters=0.6B2026.02 | 27.2 | |
| Hammer2.1Parameters=3B2026.02 | 18.7 |