Agentic on BFCL v4
70.64pass@1Ling-2.6-1T
Evaluation Results
| Method | Links | |
|---|---|---|
| Ling-2.6-1T2026.06 | 70.64 | |
| GLM-5Thinking Mode=non-thinking2026.06 | 67.57 | |
| Qwen3.5 35B-A3B2026.03 | 67.3 | |
| Ling-2.6-flash2026.06 | 66.81 | |
| Kimi-K2.5Mode=Instant2026.06 | 62.96 | |
| DeepSeek-V3.2Thinking Mode=nothink2026.06 | 60.05 | |
| GPT-5.4Reasoning Mode=non-reasoning2026.06 | 56.09 | |
| Nemotron-3-Nano 30B-A3B2026.03 | 53.8 | |
| Nemotron-Cascade-2 30B-A3B2026.03 | 52.9 | |
| GPT-5.4-miniEvaluation Setting=non-reasoning2026.06 | 49.72 | |
| Qwen3-4B-Thinking-2507Active / Total Parameters=4.0B / 4.0B, Sampling Settings=Recommended sampling settings2026.05 | 49.7 | |
| Qwen3.5-4BActive / Total Parameters=4.0B / 4.0B, Sampling Settings=Recommended sampling settings2026.05 | 45.2 | |
| GPT-OSS-120BEvaluation Setting=low2026.06 | 43.3 | |
| ZAYA1-8BActive / Total Parameters=0.7B / 8.0B, Sampling Settings=T=0.6, top-p=0.95, top-k=202026.05 | 40.5 | |
| Nemotron-3-Super 120B-A12BEvaluation Setting=non-reasoning2026.06 | 35.12 | |
| Gemma-4-E4B-itActive / Total Parameters=4.0B / 8.0B, Sampling Settings=Recommended sampling settings2026.05 | 31.7 |