Agent Planning and API Calling on ToolBench
82.5Plan ACCGPT-4o
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-4o2025.06 | 82.5 | 57 | 31.1 | 22.2 | 37.3 | 99.9 | 55 | |
| HiMA-R1Model Parameters=3B+3B, Thinking Process=Enabled2025.06 | 73.5 | 48.5 | 17.6 | 31.5 | 39 | 96.7 | 51.2 | |
| HiMA-SFTModel Parameters=7B+3B, Thinking Process=Enabled2025.06 | 73.3 | 47 | 16.3 | 29.6 | 36.8 | 94.5 | 49.6 | |
| Qwen2.5-32BModel Parameters=32B2025.06 | 72.7 | 43.7 | 15.1 | 21 | 28.8 | 99.3 | 46.8 | |
| DeepSeek-R12025.06 | 72.3 | 45.2 | 18.7 | 18.2 | 28.5 | 100 | 47.1 | |
| DeepSeek-V32025.06 | 68.4 | 38 | 14.9 | 14.3 | 23.6 | 99.4 | 43.1 | |
| HiMA-SFT-noModel Parameters=7B+3B, Thinking Process=Disabled2025.06 | 55.7 | 33 | 10.1 | 20.5 | 26.5 | 95.7 | 40.3 | |
| Qwen2.5-14BModel Parameters=14B2025.06 | 42.2 | 15 | 3.7 | 7.1 | 10.1 | 100 | 29.7 |