# GUI Agent Task Success on OSWorld

Source: [GUI Agent Task Success on OSWorld](<https://www.sota2.com/research/sota/gui-agent-task-success-on-osworld>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-04T13:50:56.070Z

Evaluation of GUI Agent Task Success performance on the OSWorld dataset, measured by Success Rate.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | GUI Agent Task Success |
| Dataset (including any stated split) | OSWorld |
| Metric | Success Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Success Rate](<https://www.sota2.com/research/sota/gui-agent-task-success-on-osworld.md?metric=Success%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Success Rate | Result date | Report paper |
| --- | --- | --- | --- |
| UI-TARS-7B-DPO + ROSA2 | 24.4 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| UI-TARS-7B-SFT + ROSA2 | 23.6 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| UI-TARS-7B-DPO + ROSA | 18 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| UI-TARS-7B-SFT + ROSA | 17.8 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| UI-TARS-7B-DPO + TextGrad | 14.9 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| UI-TARS-7B-DPO | 14.8 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| UI-TARS-7B-SFT + TextGrad | 13.7 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| UI-TARS-7B-SFT | 13.2 | Not recorded | 69a66c1c2d603e6de3e3cebc |
| ShowUI-Aloha | 0.601 | Not recorded | 6965d1b16343fa78c8323915 |
| CoAct-1 | 0.564 | Not recorded | 6965d1b16343fa78c8323915 |
| Agent S2.5 | 0.542 | Not recorded | 6965d1b16343fa78c8323915 |
| Jedi-7B | 0.506 | Not recorded | 6965d1b16343fa78c8323915 |
| GTA-1-7B | 0.486 | Not recorded | 6965d1b16343fa78c8323915 |
| Claude 4 Sonnet | 0.439 | Not recorded | 6965d1b16343fa78c8323915 |
| OpenAI CUA 4o | 0.313 | Not recorded | 6965d1b16343fa78c8323915 |
| UI-TARS-1.5-7B | 0.294 | Not recorded | 6965d1b16343fa78c8323915 |

### UI-TARS-7B-DPO + ROSA2

Success Rate: 24.4. Result ID: 69a838a36dbb7075b94ed1a3.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

[Implementation](<https://github.com/kithib/ROSA2>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-DPO"}. This record does not assert independent reproduction.

### UI-TARS-7B-SFT + ROSA2

Success Rate: 23.6. Result ID: 69a838a36dbb7075b94ed19f.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

[Implementation](<https://github.com/kithib/ROSA2>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-SFT"}. This record does not assert independent reproduction.

### UI-TARS-7B-DPO + ROSA

Success Rate: 18. Result ID: 69a838a36dbb7075b94ed1a2.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-DPO"}. This record does not assert independent reproduction.

### UI-TARS-7B-SFT + ROSA

Success Rate: 17.8. Result ID: 69a838a36dbb7075b94ed19e.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-SFT"}. This record does not assert independent reproduction.

### UI-TARS-7B-DPO + TextGrad

Success Rate: 14.9. Result ID: 69a838a36dbb7075b94ed1a1.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-DPO"}. This record does not assert independent reproduction.

### UI-TARS-7B-DPO

Success Rate: 14.8. Result ID: 69a838a36dbb7075b94ed1a0.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a61e209131cea6e2ba.md>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-DPO"}. This record does not assert independent reproduction.

### UI-TARS-7B-SFT + TextGrad

Success Rate: 13.7. Result ID: 69a838a36dbb7075b94ed19d.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-SFT"}. This record does not assert independent reproduction.

### UI-TARS-7B-SFT

Success Rate: 13.2. Result ID: 69a838a36dbb7075b94ed19c.

[Reporting paper](<https://www.sota2.com/research/paper/69a66c1c2d603e6de3e3cebc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a61e209131cea6e2ba.md>)

Recorded evaluation configuration: {"Backbone":"UI-TARS-7B-SFT"}. This record does not assert independent reproduction.

### ShowUI-Aloha

Success Rate: 0.601. Result ID: 6997cc0d5698665ec4233eb8.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

Recorded evaluation configuration: {"Type":"Human Guided"}. This record does not assert independent reproduction.

### CoAct-1

Success Rate: 0.564. Result ID: 6997cc0d5698665ec4233eb7.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a861e209131cea83b00.md>)

Recorded evaluation configuration: {"Type":"Agentic"}. This record does not assert independent reproduction.

### Agent S2.5

Success Rate: 0.542. Result ID: 6997cc0d5698665ec4233eb6.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b41e209131cea74db4.md>)

Recorded evaluation configuration: {"Type":"Agentic"}. This record does not assert independent reproduction.

### Jedi-7B

Success Rate: 0.506. Result ID: 6997cc0d5698665ec4233eb5.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79861e209131cea7e01e.md>)

Recorded evaluation configuration: {"Type":"Agentic"}. This record does not assert independent reproduction.

### GTA-1-7B

Success Rate: 0.486. Result ID: 6997cc0d5698665ec4233eb4.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be61e209131cea8b2ba.md>)

Recorded evaluation configuration: {"Type":"Agentic"}. This record does not assert independent reproduction.

### Claude 4 Sonnet

Success Rate: 0.439. Result ID: 6997cc0d5698665ec4233eb3.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

Recorded evaluation configuration: {"Type":"General"}. This record does not assert independent reproduction.

### OpenAI CUA 4o

Success Rate: 0.313. Result ID: 6997cc0d5698665ec4233eb2.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

Recorded evaluation configuration: {"Type":"Specialized"}. This record does not assert independent reproduction.

### UI-TARS-1.5-7B

Success Rate: 0.294. Result ID: 6997cc0d5698665ec4233eb1.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a61e209131cea6e2ba.md>)

Recorded evaluation configuration: {"Type":"Specialized"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
