Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Task Execution research benchmarks · SOTA2 Research

Task Execution

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

100Language Detection (Reference)

12

Apr 13, 2026

TEXTCRAFT-SYNTH 8K context Easy (evaluation)

100Success Rate

4

May 8, 2026

200 TE-labeled queries (test)

62TE-Success@1

3

Feb 26, 2026

TEXTCRAFT-SYNTH Hard (eval)

Recursive Agent

88Success Rate

2

May 8, 2026

TEXTCRAFT-SYNTH Medium (eval)

Recursive Agent

98Success Rate

2

May 8, 2026

TEXTCRAFT-SYNTH All (eval)

Recursive Agent

96Success Rate

2

May 8, 2026

TEXTCRAFT-SYNTH 8K context Hard (evaluation set)

88Success Rate

2

May 8, 2026

TEXTCRAFT-SYNTH 8K context Medium (evaluation set)

96SR

2

May 8, 2026

TEXTCRAFT-SYNTH 8K context All (test)

95Success Rate

2

May 8, 2026

Popular datasets

TEXTCRAFT-SYNTH TE-labeled queries TextCraft IHEval

Follow for updates

Join SOTA2 Contact