Tool Reasoning on ToolBench G2
93Pass RateToolGate
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ToolGateModel=GPT-5.22026.01 | 93 | 90.5 | |
| ToolGateModel=Gemini 3 Pro2026.01 | 91.3 | 88 | |
| ToolChain*Model=GPT-5.22026.01 | 90.5 | 88.3 | |
| LATSModel=GPT-5.22026.01 | 88.5 | 85.3 | |
| ToolChain*Model=Gemini 3 Pro2026.01 | 88.3 | 85 | |
| LATSModel=Gemini 3 Pro2026.01 | 85.8 | 82 | |
| ToolGateModel=Deepseek V3.22026.01 | 85.5 | 80 | |
| ToolGateModel=Qwen-3-235B2026.01 | 82.5 | 78 | |
| ToolChain*Model=Deepseek V3.22026.01 | 82.5 | 75.3 | |
| Tool-PlannerModel=GPT-5.22026.01 | 82 | 80.5 | |
| Tool-PlannerModel=Gemini 3 Pro2026.01 | 80.5 | 78.3 | |
| LATSModel=Deepseek V3.22026.01 | 80 | 72.5 | |
| ToolChain*Model=Qwen-3-235B2026.01 | 79.3 | 72.5 | |
| LATSModel=Qwen-3-235B2026.01 | 78 | 70.3 | |
| DFSDTModel=GPT-5.22026.01 | 75.3 | 78 | |
| Tool-PlannerModel=Deepseek V3.22026.01 | 73.8 | 70 | |
| DFSDTModel=Gemini 3 Pro2026.01 | 72 | 75.8 | |
| Tool-PlannerModel=Qwen-3-235B2026.01 | 70.5 | 68.8 | |
| ReACTModel=GPT-5.22026.01 | 65 | 63.2 | |
| ReACTModel=Gemini 3 Pro2026.01 | 63.8 | 57 | |
| DFSDTModel=Deepseek V3.22026.01 | 63 | 69.3 | |
| DFSDTModel=Qwen-3-235B2026.01 | 61.5 | 67.5 | |
| ReACTModel=Deepseek V3.22026.01 | 55.3 | 51 | |
| ReACTModel=Qwen-3-235B2026.01 | 53.5 | — |