Function Calling on BFCL (Accuracy %)
86.67Accuracy (%)Opus-4.6 (1M)
Evaluation Results
| Method | Links | |
|---|---|---|
| Opus-4.6 (1M)Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 86.67 | |
| Official Instruct ModelProtocol=Official Instruct, Backbone=SmolLM3-3B2026.05 | 84 | |
| GLM-4.7 & ANDES (Ours)Protocol=Proposed Method, Backbone=SmolLM3-3B2026.05 | 78.67 | |
| Opus-4.6Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 75.92 | |
| GLM-4.7 (Scaffold-only)Protocol=Proposed Method, Backbone=SmolLM3-3B2026.05 | 70 | |
| Opus-4.7 (xHigh)Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 62.33 | |
| GPT-5.2Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 33.33 | |
| GPT-5.4 (High)Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 29.67 | |
| Gemini-3.1-ProProtocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 27.67 | |
| Base Model (SmolLM3-3B)Protocol=Zero-Shot, Backbone=SmolLM3-3B2026.05 | 0 | |
| Sonnet-4.5Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 0 | |
| Qwen3-MaxProtocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 0 | |
| Kimi-K2-ThinkingProtocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 0 | |
| MiniMax-M2.1Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 0 | |
| GPT-5.1-Codex-MaxProtocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 0 | |
| MiniMax-M2.5Protocol=Agent-Post-Trained, Backbone=SmolLM3-3B2026.05 | 0 | |
| GLM-4.7 (OpenCode)Protocol=Proposed Method, Backbone=SmolLM3-3B2026.05 | 0 |