Tool Use on BFCL (v4, v3, v4+H)
77BFCL v4 ScoreVanilla
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| VanillaModel=Opus 4.72026.07 | 77 | 42 | 85.5 | |
| NREModel=Haiku 4.52026.07 | 73 | 41.5 | 91.5 | |
| VanillaModel=Sonnet 4.62026.07 | 73 | 45 | 83.5 | |
| NREModel=Kimi-k2.62026.07 | 70.5 | 42.5 | 89 | |
| NREModel=Mistral 3.52026.07 | 70.5 | 43.5 | 85 | |
| NREModel=Deepseek-v32026.07 | 70.5 | 39.5 | 87.5 | |
| VanillaModel=Kimi-k2.62026.07 | 70 | 39 | 75 | |
| GEPAModel=Kimi-k2.62026.07 | 70 | 41 | 87.5 | |
| NREModel=gpt-5.4-mini2026.07 | 67 | 44 | 85.5 | |
| NREModel=gpt-oss-120b2026.07 | 64 | 36 | 90 | |
| VanillaModel=Haiku 4.52026.07 | 62 | 42 | 73 | |
| VanillaModel=gpt-oss-120b2026.07 | 61 | 30 | 69.5 | |
| GEPAModel=gpt-oss-120b2026.07 | 57.5 | 31 | 74 | |
| VanillaModel=Deepseek-R12026.07 | 57 | 30.5 | 75.5 | |
| RLMModel=Kimi-k2.62026.07 | 56 | 29 | 68 | |
| VanillaModel=Deepseek-v32026.07 | 46.5 | 28 | 61.5 | |
| VanillaModel=gpt-5.4-mini2026.07 | 38.5 | 22 | 56 | |
| GEPAModel=Deepseek-v32026.07 | 26.5 | 19.5 | 41.5 | |
| RLMModel=gpt-oss-120b2026.07 | 15.5 | 1 | 28 | |
| RLMModel=Deepseek-v32026.07 | 2.5 | 1.5 | 5.5 |