Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Tool Identification research benchmarks · SOTA2 Research

Tool Identification

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

BFCL out-of-domain

38.06Exact Match

9

Apr 14, 2026

In-domain unseen

75.86EM

9

Apr 14, 2026

In-domain (seen)

85.95Exact Match (EM)

9

Apr 14, 2026

91.34BLEU-4

4

Jun 16, 2026

BFCL multi-turn category (test)

34.48Accuracy

4

Apr 14, 2026

Tool Use Evaluation (test)

78.3EM Accuracy

3

Apr 14, 2026

ToolACE multi-turn (test)

75.34Accuracy

2

Apr 14, 2026

Popular datasets

In-domain BFCL ToolAce Tool Use Evaluation RAMIE

Follow for updates

Join SOTA2 Contact