End-to-end Tool-use on ToolBench v1 (I2)
52.2SoPRToolGen*
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ToolGen*2026.01 | 52.2 | 62.26 | |
| ToolLlama*Setting=Retrieval2026.01 | 49.96 | 61.32 | |
| ToolLlama-2*Setting=Retrieval2026.01 | 49.21 | 53.77 | |
| ToolGenSetting=Direct Generation2026.01 | 45.13 | 42.45 | |
| ToolGen2026.01 | 45.13 | 42.45 | |
| ToolWeaverSetting=Direct Generation2026.01 | 44.03 | 48.11 | |
| ToolWeaver2026.01 | 44.03 | 48.11 | |
| GPT-3.5*Setting=Retrieval2026.01 | 41.19 | 53.77 | |
| GPT-4o-miniSetting=Retrieval (Re.)2026.01 | 40.41 | — | |
| GPT-4o-miniSetting=Retrieval2026.01 | 40.41 | 52.83 | |
| ToolLlama-2Setting=Retrieval (Re.)2026.01 | 24.69 | 30.19 | |
| ToolLlama-2Setting=Retrieval2026.01 | 24.69 | 30.19 |