Tool Use
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
75.54Overall Accuracy
19
Jun 16, 2026
54.87Answer Correctness
18
Jun 2, 2026
45.45Accuracy
18
May 14, 2026
66.22Accuracy
18
May 14, 2026
69.2Task Accuracy
18
Jul 3, 2026
5.6Energy (Wh)
18
Feb 26, 2026
0.79AvgZ Score
18
Feb 26, 2026
100Functionality Score
18
Feb 26, 2026
99.63Func Success Rate
18
Feb 26, 2026
99.63Func
18
Feb 26, 2026
99.64Func Success Rate
18
Feb 26, 2026
78.9Accuracy
16
Jun 17, 2026
81Accuracy
15
Apr 14, 2026
90Accuracy
15
Apr 14, 2026
0.925Para
15
Feb 26, 2026
56.25Para Score
15
Feb 26, 2026
33.4Average Success Rate
14
May 19, 2026
86.02Single Turn Success Rate
14
May 19, 2026
4.1Tool Hit@1Δ
14
Apr 16, 2026
68.5Avg@16
14
Apr 3, 2026
67.5TAU-AIR Score
14
Feb 26, 2026
58.2Task Completion Rate
14
Feb 26, 2026
76PR
14
Feb 26, 2026
99.2Wellformedness
14
Feb 26, 2026
91.6Accuracy
13
May 19, 2026