Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

ToolBench dataset and benchmarks – Page 2 · SOTA2 Research

Research Datasets

ToolBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Function Calling

ToolBench I2-Inst

71.4Pass Rate

14

Function Calling

ToolBench I1-Inst

57.1Pass Rate

14

ToolBench 50 APIs v1 (test)

99.2Wellformedness

14

ToolBench I3 (test)

76.63Recall@3

13

ToolBench I2 (test)

75.72Recall@3

13

ToolBench G1 set

88.192Win Rate (G1-Instruction)

13

Tool-use Planning

ToolBench Average over all sets

86.54Win Rate

13

Tool-use Planning

ToolBench G3-Instruction

0.937Win Rate

13

Tool-use Planning

ToolBench G2-Category

78.78Win Rate

13

Tool-use Planning

ToolBench G2-Instruction

87.59Win Rate

13

Tool-use instruction following

ToolBench Average

71.1Pass Rate

13

Tool-use instruction following

ToolBench I3-Instruction

71Pass Rate

13

Tool-use instruction following

ToolBench I2-Category

0.775Pass Rate

13

Tool-use instruction following

ToolBench I2-Instruction

81.5Pass Rate

13

Tool-use instruction following

ToolBench I1-Category

67Pass Rate

13

Tool-use instruction following

ToolBench I1-Tool

71.5Pass Rate

13

Tool-use instruction following

ToolBench I1-Instruction

64Pass Rate

13

ToolBench All v1.0

97Tool Call Rate (TCR)

12

ToolBench Hard v1.0

97Tool Call Rate (TCR)

12

ToolBench Medium v1.0

96.3TCR

12

ToolBench Easy v1.0

97.9Tool Call Rate (TCR)

12

ToolBench

58.5F1 Score

12

Single-turn Tool Use

ToolBench

19.6Score

12

ToolBench

61.27Pass Rate

12

End-to-end Tool-use

ToolBench I3 v1

52.19SoPR

12

Page 2 of 4

Popular tasks

Tool Retrieval Tool Use Tool-use instruction following End-to-end Tool-use Tool-use Planning

Follow for updates

Join SOTA2 Contact