GUI Task Automation on OS-Marathon Transcript domain (Level 2)
86.1SWAHuman
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HumanStep=2002026.01 | 86.1 | 50 | |
| HumanStep=1502026.01 | 69.18 | 25 | |
| HumanStep=1002026.01 | 53.04 | 25 | |
| AgentS2.5 + GPT5 w/ FCWDStep=2002026.01 | 42.05 | 0 | |
| AgentS2.5 + GPT5 w/ FCWDStep=1502026.01 | 38.78 | 0 | |
| HumanStep=502026.01 | 27.38 | 0 | |
| AgentS2.5 + GPT5 w/ FCWDStep=1002026.01 | 25.08 | 0 | |
| AgentS2.5 + GPT5Step=2002026.01 | 23.53 | 0 | |
| AgentS2.5 + GPT5Step=1502026.01 | 22.06 | 0 | |
| AgentS2.5 + GPT5Step=1002026.01 | 17.65 | 0 | |
| AgentS2.5 + GPT5 w/ FCWDStep=502026.01 | 10.61 | 0 | |
| AgentS2.5 + GPT5Step=502026.01 | 5.88 | 0 | |
| OpenCUA-7BStep=502026.01 | 0 | 0 | |
| OpenCUA-7BStep=1002026.01 | 0 | 0 | |
| OpenCUA-7BStep=1502026.01 | 0 | 0 | |
| OpenCUA-7BStep=2002026.01 | 0 | 0 | |
| UI-TARS-1.5-7BStep=502026.01 | 0 | 0 | |
| UI-TARS-1.5-7BStep=1002026.01 | 0 | 0 | |
| UI-TARS-1.5-7BStep=1502026.01 | 0 | 0 | |
| UI-TARS-1.5-7BStep=2002026.01 | 0 | 0 |