ToolBench
Benchmarks
TaskDatasetSOTA resultTrendResults
ToolBench I2-Inst
71.4Pass Rate
14
ToolBench I1-Inst
57.1Pass Rate
14
ToolBench 50 APIs v1 (test)
99.2Wellformedness
14
ToolBench I3 (test)
76.63Recall@3
13
ToolBench I2 (test)
75.72Recall@3
13
ToolBench G1 set
88.192Win Rate (G1-Instruction)
13
ToolBench Average over all sets
86.54Win Rate
13
ToolBench G3-Instruction
0.937Win Rate
13
ToolBench G2-Category
78.78Win Rate
13
ToolBench G2-Instruction
87.59Win Rate
13
ToolBench Average
71.1Pass Rate
13
ToolBench I3-Instruction
71Pass Rate
13
ToolBench I2-Category
0.775Pass Rate
13
ToolBench I2-Instruction
81.5Pass Rate
13
ToolBench I1-Category
67Pass Rate
13
ToolBench I1-Tool
71.5Pass Rate
13
ToolBench I1-Instruction
64Pass Rate
13
ToolBench All v1.0
97Tool Call Rate (TCR)
12
ToolBench Hard v1.0
97Tool Call Rate (TCR)
12
ToolBench Medium v1.0
96.3TCR
12
ToolBench Easy v1.0
97.9Tool Call Rate (TCR)
12
ToolBench
58.5F1 Score
12
ToolBench
19.6Score
12
ToolBench
61.27Pass Rate
12
ToolBench I3 v1
52.19SoPR
12