Terminal Agent Tasks on TerminalBench 2.0
57.8Success ScoreClaude-Opus-4.5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude-Opus-4.5Size=-, Scaffold=Terminus 22026.06 | 57.8 | — | — | — | |
| Gemini 3 Pro PreviewSize=-, Scaffold=Terminus 22026.06 | 56.9 | — | — | — | |
| GPT-5.2Size=-, Scaffold=Terminus 22026.06 | 54 | — | — | — | |
| GLM-4.7Size=358B, Scaffold=Terminus 22026.06 | 41 | — | — | — | |
| CLI-Universe-32BSize=32B, Scaffold=Terminus 22026.06 | 33.4 | — | — | — | |
| LiberCoder-235BSize=235B, Scaffold=OpenHands2026.06 | 31 | — | — | — | |
| SkillSynth-32BSize=32B, Scaffold=Terminus 22026.06 | 29.6 | — | — | — | |
| Minimax-M2.1Size=229B, Scaffold=Terminus 22026.06 | 29.2 | — | — | — | |
| Kimi-K2-InstructSize=1T, Scaffold=Terminus 22026.06 | 27.8 | — | — | — | |
| Nemotron-Terminal-32BSize=32B, Scaffold=Terminus 22026.06 | 27.4 | — | — | — | |
| Qwen3-Coder-480BSize=480B, Scaffold=Terminus 22026.06 | 23.9 | — | — | — | |
| CLI-Universe-14BSize=14B, Scaffold=Terminus 22026.06 | 23 | — | — | — | |
| TerminalTraj-32BSize=32B, Scaffold=Terminus 22026.06 | 22 | — | — | — | |
| Nemotron-Terminal-14BSize=14B, Scaffold=Terminus 22026.06 | 20.2 | — | — | — | |
| SkillSynth-14BSize=14B, Scaffold=Terminus 22026.06 | 19.9 | — | — | — | |
| LiberCoder-32BSize=32B, Scaffold=OpenHands2026.06 | 19.5 | — | — | — | |
| TerminalTraj-14BSize=14B, Scaffold=Terminus 22026.06 | 19.1 | — | — | — | |
| Qwen3-Coder-30B-A3BSize=30B, Scaffold=Terminus 22026.06 | 14.6 | — | — | — | |
| SkillSynth-8BSize=8B, Scaffold=Terminus 22026.06 | 13.5 | — | — | — | |
| Nemotron-Terminal-8BSize=8B, Scaffold=Terminus 22026.06 | 13 | — | — | — | |
| CLI-Universe-8BSize=8B, Scaffold=Terminus 22026.06 | 10.9 | — | — | — | |
| TerminalTraj-7BSize=7B, Scaffold=Terminus 22026.06 | 10.1 | — | — | — | |
| Qwen3-14BSize=14B, Scaffold=Terminus 22026.06 | 4 | — | — | — | |
| Qwen3-32BSize=32B, Scaffold=Terminus 22026.06 | 3.4 | — | — | — | |
| Qwen3-8BSize=8B, Scaffold=Terminus 22026.06 | 2.5 | — | — | — | |
| OT-SFTSetup=SFT2026.05 | — | 5.62 | 10.45 | 12.36 | |
| OT-SFTSetup=GRPO2026.05 | — | 7.64 | 14.38 | 17.98 | |
| OT-SFTSetup=ECHO2026.05 | — | 7.87 | 13.82 | 17.98 | |
| Qwen3-14BSetup=Base2026.05 | — | 4.27 | 8.99 | 12.36 | |
| Qwen3-14BSetup=GRPO2026.05 | — | 5.17 | 10.67 | 13.48 | |
| Qwen3-14BSetup=ECHO2026.05 | — | 10.79 | 16.52 | 19.1 | |
| Qwen3-8BSetup=Base2026.05 | — | 1.57 | 3.71 | 4.49 | |
| Qwen3-8BSetup=GRPO2026.05 | — | 2.7 | 6.74 | 8.99 | |
| Qwen3-8BSetup=ECHO2026.05 | — | 5.17 | 10.45 | 13.48 |