GUI Task Automation on OS-Marathon Transcript domain (Level 1)
100SWAHuman
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HumanStep=1002026.01 | 100 | 100 | |
| AgentS2.5 + GPT5 w/ FCWDStep=1002026.01 | 91.74 | 50 | |
| HumanStep=502026.01 | 75 | 50 | |
| AgentS2.5 + GPT5 w/ FCWDStep=502026.01 | 66.29 | 25 | |
| AgentS2.5 + GPT5Step=1002026.01 | 27.08 | 25 | |
| AgentS2.5 + GPT5Step=502026.01 | 19.94 | 0 | |
| OpenCUA-7BStep=502026.01 | 0 | 0 | |
| OpenCUA-7BStep=1002026.01 | 0 | 0 | |
| UI-TARS-1.5-7BStep=502026.01 | 0 | 0 | |
| UI-TARS-1.5-7BStep=1002026.01 | 0 | 0 |