Grounding on OSWorld
64.7Overall ScoreMGA w/ GPT-5
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MGA w/ GPT-5Steps=50, Planner Agent=GPT-5, Memory Agent=qwen3-8b2025.10 | 64.7 | 64.7 | 64.4 | 85.4 | 87.5 | 47.7 | |
| OS-SYMPHONY w/ GPT-5Steps=502025.10 | 63.6 | 64.9 | 61.2 | 69.2 | 75 | 54.9 | |
| GTA1-7b w/ GPT-5Steps=502025.10 | 61 | — | — | — | — | — | |
| CoAct-1 w/ GPT-5Steps=1502025.10 | 60.8 | 62.9 | 61.7 | 71.4 | 75 | 47.8 | |
| CoAct-1 w/ GPT-5Steps=1002025.10 | 59.9 | 62.9 | 57.9 | 71.4 | 75 | 47.8 | |
| Claude-Sonnet-4.5Steps=502025.10 | 58.1 | 62.4 | 57.6 | 63.2 | 70.8 | 47 | |
| OS-SYMPHONY w/ GPT5-MiniSteps=502025.10 | 58.1 | 58.2 | 61.4 | 75 | 73.7 | 47.4 | |
| UiPath w/ GPT-5Steps=502025.10 | 53.7 | 49.5 | 62.1 | 71.4 | 73.9 | 37.3 | |
| UI-TARS-2Steps=1002025.10 | 53.1 | 61.1 | 62.1 | 61.2 | 41.6 | 34.1 | |
| GTA1-7b w/ o3Steps=1002025.10 | 53.1 | 54.6 | 60.3 | 61.2 | 62.5 | 38.3 | |
| MGA w/ o3Steps=50, Planner Agent=o3, Memory Agent=o32025.10 | 52.9 | 49 | 62.8 | 70.6 | 68.2 | 36.4 | |
| Jedi-7B w/ o3Steps=502025.10 | 50.6 | 47 | 62.1 | 69.4 | 54.2 | 34.9 | |
| GTA1-7b w/ o3Steps=502025.10 | 48.6 | 46.1 | 44.9 | 77.6 | 58.3 | 37.1 | |
| Agent S3 w/ GPT-5-MiniSteps=502025.10 | 47.5 | 54.6 | 46.6 | 44.9 | 62.5 | 37 | |
| OS-SYMPHONY w/ Qwen3-VL-32BSteps=502025.10 | 46.9 | 40.9 | 53.5 | 75.1 | 58.3 | 31.2 | |
| OpenCUA-72BSteps=1002025.10 | 44.9 | 44.7 | 49.9 | 72.5 | 61.1 | 22.1 | |
| UI-TARSSteps=1002025.10 | 41.8 | 50.4 | 55.6 | 51 | 41.6 | 14.6 | |
| Qwen3-VL-32B-ThinkingSteps=502025.10 | 41 | — | — | — | — | — | |
| DeepMiner-Mano-7BSteps=1002025.10 | 40.1 | 39.2 | 44.8 | 73.4 | 50 | 17.2 | |
| OpenCUA-32bSteps=502025.10 | 34.1 | 29.9 | 40.9 | 65.3 | 60.9 | 14.6 | |
| Qwen3-VL-32B-InstructSteps=502025.10 | 32.4 | — | — | — | — | — | |
| O3Steps=502025.10 | 17.1 | 9.4 | 20.5 | 30.6 | 37.5 | 11.8 |