Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

WHEN2TOOL dataset and benchmarks · SOTA2 Research

Research Datasets

WHEN2TOOL

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Single-hop Tool Calling

WHEN2TOOL single-hop 1.0 (test)

94.3Accuracy

90

WHEN2TOOL Overall

-1Δ Accuracy

7

WHEN2TOOL Hard

-0.8Delta Accuracy (ΔAcc)

7

WHEN2TOOL Medium

-0.7Delta Accuracy

7

WHEN2TOOL Easy

-0.3ΔAcc

7

Popular tasks

Tool Calling Single-hop Tool Calling

Follow for updates

Join SOTA2 Contact