Terminal Task Execution
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
59.6Success Rate
15
Jun 24, 2026
51Accuracy
12
Apr 29, 2026
58.9Overall avg@5 Accuracy
6
May 19, 2026
34.9Avg Pass Rate
6
Mar 31, 2026
35.2Test Accuracy
4
May 12, 2026
52.7Accuracy
2
Apr 21, 2026