Tool-calling on BFCL
90.65Non-Live Success RateGemini-3-Pro-Preview
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-3-Pro-PreviewCategory=Close-source2026.03 | 90.65 | 83.12 | 86.89 | |
| Qwen3-235B-A22B-InstCategory=Open-source / Large-scale2026.03 | 90.12 | 76.61 | 83.37 | |
| ToolACE-DEV-8BCategory=Open-source / Tool-specialized2026.03 | 89.67 | 75.2 | 82.44 | |
| Llama-3.3-70B-InstCategory=Open-source / Large-scale2026.03 | 88.02 | 76.61 | 82.32 | |
| Qwen2.5-7B-InstructTraining=Tool-DC (TB), Category=Tuned Models2026.03 | 86.67 | 79.64 | 83.16 | |
| Claude-Haiku-4.5Category=Close-source2026.03 | 86.5 | 78.68 | 82.59 | |
| Qwen2.5-7B-InstructTraining=Base, Category=Tuned Models2026.03 | 86.46 | 67.44 | 76.95 | |
| DeepSeek-V3.2-ExpCategory=Close-source2026.03 | 85.52 | 76.02 | 80.77 | |
| Hammer2.1-3BCategory=Open-source / Tool-specialized2026.03 | 85.5 | 69.5 | 77.5 | |
| Hammer2.1-7BCategory=Open-source / Tool-specialized2026.03 | 84.96 | 70.54 | 77.75 | |
| ToolACE-MT-8BCategory=Open-source / Tool-specialized2026.03 | 84.94 | 71.52 | 78.23 | |
| xLAM-2-8b-fc-rCategory=Open-source / Tool-specialized2026.03 | 84.58 | 67.95 | 76.27 | |
| Qwen2.5-7B-InstructTraining=Vanilla SFT, Category=Tuned Models2026.03 | 84.23 | 74.24 | 79.24 | |
| Llama-3.2-3B-InstructTraining=Vanilla SFT, Category=Tuned Models2026.03 | 83.31 | 62.99 | 73.15 | |
| Llama-3.2-3B-InstructTraining=Tool-DC (TB), Category=Tuned Models2026.03 | 83.17 | 63.95 | 73.56 | |
| Llama-3.2-3B-InstructTraining=Base, Category=Tuned Models2026.03 | 82.67 | 58.33 | 70.5 | |
| OpenAI o3Category=Close-source2026.03 | 81.94 | 73.21 | 77.58 |