Tool use
Benchmarks
TaskDatasetSOTA resultTrendResults
tool-use (test)
72Accuracy
24
Tool use
61.31Mean Accuracy @16
24
Tool Use Non-Live
0.925Para
15
Tool Use Live
56.25Para Score
15
Tool use
68.5Avg@16
14
Tool Use
0.792Accuracy
8
Tool-use multi-turn (test)
76.8Accuracy
6
Tool Use Domain Average
71.1Tool Use Average Accuracy
4