Agentic Tool Calling on MAVEN-Bench
71AccuracyMAVEN
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MAVENBackbone=GPT-OSS-120b, Price=$1.52026.05 | 71 | 95.1 | 67.4 | 18.2 | 9.5 | |
| Claude-Sonnet-4.5Price=$152026.05 | 70 | 94.2 | 67 | 17.7 | 9.5 | |
| Kimi-K2Price=$52026.05 | 57 | 92.4 | 65.5 | 17.7 | 9.3 | |
| Grok-4Price=$152026.05 | 55 | 88.2 | 63 | 16.8 | 8.4 | |
| GPT-OSS-120bPrice=$0.92026.05 | 48 | 88.9 | 62.6 | 17.5 | 8.7 | |
| GLM-4.5Price=$32026.05 | 43 | 88 | 62.3 | 16.9 | 8.7 | |
| o4-miniPrice=$92026.05 | 38 | 76.7 | 53.6 | 15.7 | 7.5 | |
| GPT-5Price=$152026.05 | 32 | 61.1 | 43.3 | 12.6 | 5.2 |