Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MetaTool dataset and benchmarks · SOTA2 Research

Research Datasets

MetaTool

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Tool-use agent performance

MetaTool

85.9ASR (Success Rate)

50

MetaTool

80.8Similarity

39

Tool-use decision-making

MetaTool (test)

90.2Decision Accuracy

38

MetaTool similar choices subtask (test)

83.4Accuracy

8

Adaptive Tool Use

MetaTool

520Tool Invocations Count

8

MetaTool 199 tools, 1,287 queries (30% test)

83R@1

7

Memory-Poisoning Attack

MetaTool

93.8Attack Hit Rate (AHR)

3

Tool Selection Attack

MetaTool (test)

97.2TDR

3

Popular tasks

Tool selection Adaptive Tool Use Tool-use decision-making Tool-use Agent Performance Tool Selection Attack

Follow for updates

Join SOTA2 Contact