MetaTool
Benchmarks
TaskDatasetSOTA resultTrendResults
MetaTool
85.9ASR (Success Rate)
50
MetaTool
80.8Similarity
39
MetaTool (test)
90.2Decision Accuracy
38
MetaTool similar choices subtask (test)
83.4Accuracy
8
MetaTool
520Tool Invocations Count
8
MetaTool 199 tools, 1,287 queries (30% test)
83R@1
7
MetaTool
93.8Attack Hit Rate (AHR)
3
MetaTool (test)
97.2TDR
3