TerminalBench
Benchmarks
TaskDatasetSOTA resultTrendResults
TerminalBench 1.0
54.4Accuracy
51
TerminalBench 2.0
57.8Accuracy
29
TerminalBench 2.0
57.8Score
29
TerminalBench 2.0
57.8Success Score
25
TerminalBench 1.0
56.25Score
23
TerminalBench 2
81.8Pass Rate
17
TerminalBench (held-out)
0.557AUPRC
11
TerminalBench 2 snapshot 2026-04-17
84.3Score (%)
11
TerminalBench-O
24Pass Rate
9
TerminalBench 2
39.3Pass@3
9
TerminalBench
0.338Accuracy
7
TerminalBench
98.1Success Rate
6
TerminalBench (TBench)
57.2Pass@1
5
TerminalBench (test)
0.988Mean Spearman Rho
5
TerminalBench 2.0 (test)
35.2Test Accuracy
4
TerminalBench
45Pass@8
4
TerminalBench 1.0
0.344Score
2
TerminalBench 2.0
0.243Score
2