Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Task-goal completion research benchmarks · SOTA2 Research

Task-goal completion

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

AppWorld (test challenge)

32Goal Completion Score

35

Jun 16, 2026

18.46Average Completion Score @4

7

May 19, 2026

AppWorld Hard 63 tasks (test_normal)

31.7Accuracy

4

Jun 23, 2026

AppWorld Medium 48 tasks (test_normal)

43.8Accuracy

4

Jun 23, 2026

AppWorld Easy normal 57 tasks (test)

73.7Accuracy

4

Jun 23, 2026

AppWorld Average 168 tasks (test normal)

44Accuracy

4

Jun 23, 2026

AppWorld Challenge Qwen-2.5-32B (test)

51Average Task Completion Score

4

Mar 13, 2026

AppWorld Normal Qwen-2.5-32B (test)

75Average Task Completion Score

4

Mar 13, 2026

Popular datasets

Follow for updates

Join SOTA2 Contact