Tool-augmented reasoning on API-Bank
79.1Success RateGenEnv
Evaluation results
| Method | Links | |
|---|---|---|
| GenEnvScale group=7B Models, Model Size=7B2025.12 | 79.1 | |
| Llama 3.1 405BScale group=Large Scale Models (> 10B), Model Size=405B2025.12 | 74.4 | |
| Qwen 3 14BScale group=Large Scale Models (> 10B), Model Size=14B2025.12 | 66.7 | |
| ReSearchScale group=7B Models, Model Size=7B2025.12 | 65.3 | |
| Llama 3.1 70BScale group=Large Scale Models (> 10B), Model Size=70B2025.12 | 64.3 | |
| Qwen 3 32BScale group=Large Scale Models (> 10B), Model Size=32B2025.12 | 63.8 | |
| SearchR1Scale group=7B Models, Model Size=7B2025.12 | 63.3 | |
| Qwen 2.5 7BScale group=7B Models, Model Size=7B2025.12 | 61.6 | |
| Qwen 2.5 72BScale group=Large Scale Models (> 10B), Model Size=72B2025.12 | 54.9 | |
| ToRLScale group=7B Models, Model Size=7B2025.12 | 54.1 | |
| GPT-OSS 120BScale group=Large Scale Models (> 10B), Model Size=120B2025.12 | 53.6 | |
| GPT-OSS 20BScale group=Large Scale Models (> 10B), Model Size=20B2025.12 | 41.2 |