Tool Use
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
99.61Average Success Rate (ASR)
62
May 27, 2026
80.67Average Pass Rate
53
May 15, 2026
85.5Average Pass@1
45
Jun 12, 2026
94Accuracy
45
Jun 2, 2026
72.9Tool Selection Accuracy
35
Apr 21, 2026
84.8Tool Selection
35
Apr 21, 2026
76.5Accuracy
33
Jul 2, 2026
57.5Total Success Rate
31
Jul 2, 2026
83.7Pass@1
28
Mar 24, 2026
72.8I2 Category Success
28
Jun 2, 2026
77.9Tool Use Success Rate
26
May 13, 2026
59.97R-F1
24
Jul 7, 2026
99.62R-F1
24
Jul 7, 2026
72Accuracy
24
May 7, 2026
92.29Task Accuracy
24
Feb 26, 2026
54.75Accuracy
24
Feb 26, 2026
52.9Accuracy (Perturbed)
21
May 13, 2026
77.9Clean Accuracy
21
May 13, 2026
76.8Avg1 Score
20
Jul 7, 2026
77LiveMCP Score
20
Jul 7, 2026
77BFCL v4 Score
20
Jul 7, 2026
50TSR
20
Jun 16, 2026
51.98Accuracy
20
May 4, 2026
31Base Score
19
Jun 25, 2026
65.2Pass Rate
19
Jun 16, 2026