Tool Reasoning on ToolBench (G3)
91.8Pass RateToolGate
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ToolGateModel=GPT-5.22026.01 | 91.8 | 95.3 | |
| ToolGateModel=Gemini 3 Pro2026.01 | 90 | 93.5 | |
| ToolChain*Model=GPT-5.22026.01 | 88.5 | 92.5 | |
| ToolChain*Model=Gemini 3 Pro2026.01 | 85.8 | 90 | |
| ToolGateModel=Deepseek V3.22026.01 | 85.3 | 81.3 | |
| LATSModel=GPT-5.22026.01 | 85 | 90.8 | |
| LATSModel=Gemini 3 Pro2026.01 | 82.5 | 88.3 | |
| ToolGateModel=Qwen-3-235B2026.01 | 81 | 82.3 | |
| ToolChain*Model=Deepseek V3.22026.01 | 81 | 88.8 | |
| LATSModel=Deepseek V3.22026.01 | 80.3 | 85.5 | |
| Tool-PlannerModel=GPT-5.22026.01 | 78.3 | 85 | |
| ToolChain*Model=Qwen-3-235B2026.01 | 78 | 83.5 | |
| LATSModel=Qwen-3-235B2026.01 | 77.8 | 83.3 | |
| Tool-PlannerModel=Gemini 3 Pro2026.01 | 75 | 82.8 | |
| Tool-PlannerModel=Deepseek V3.22026.01 | 68 | 75.5 | |
| Tool-PlannerModel=Qwen-3-235B2026.01 | 65.5 | 72.3 | |
| DFSDTModel=GPT-5.22026.01 | 63.8 | 70.5 | |
| DFSDTModel=Gemini 3 Pro2026.01 | 60.3 | 68.5 | |
| ReACTModel=GPT-5.22026.01 | 58.3 | 59.5 | |
| ReACTModel=Gemini 3 Pro2026.01 | 55.5 | 56.5 | |
| DFSDTModel=Deepseek V3.22026.01 | 50.3 | 58.8 | |
| DFSDTModel=Qwen-3-235B2026.01 | 48.8 | 56.8 | |
| ReACTModel=Deepseek V3.22026.01 | 48.5 | 53.5 | |
| ReACTModel=Qwen-3-235B2026.01 | 46 | — |