GUI Navigation on OSWorld Verified
91.7OS Success RateVLAA-GUI w/ Gemini 3 Flash
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| VLAA-GUI w/ Gemini 3 FlashStep Budget=1002026.04 | 91.7 | 64.9 | 74.85 | 67.33 | 63.4 | 68.77 | |
| VLAA-GUI w/ Opus 4.6Step Budget=1002026.04 | 91.7 | 82.87 | 75.17 | 83.67 | 65.6 | 77.45 | |
| VLAA-GUI w/ Opus 4.5 + MAI-UIStep Budget=1002026.04 | 91.67 | 84.26 | 72.77 | 83.67 | 61.09 | 76.26 | |
| VLAA-GUI w/ Opus 4.5Step Budget=152026.04 | 87.5 | 57.16 | 59.69 | 71.43 | 45.2 | 58.58 | |
| VLAA-GUI w/ Opus 4.5Step Budget=502026.04 | 87.5 | 75.97 | 71.38 | 79.59 | 55.6 | 71 | |
| HIPPO w/ Opus 4.5Step Budget=1002026.04 | 87.5 | 74.27 | 69.27 | 95.92 | 64.31 | 74.49 | |
| VLAA-GUI w/ Opus 4.5Step Budget=1002026.04 | 87.5 | 79.38 | 76.57 | 81.63 | 61 | 74.89 | |
| VLAA-GUI w/ Gemini 3.1 ProStep Budget=152026.04 | 83.3 | 52.99 | 54.33 | 61.22 | 34.7 | 51.69 | |
| VLAA-GUI w/ Sonnet 4.6Step Budget=152026.04 | 83.3 | 69.72 | 58.72 | 57.13 | 60.2 | 64.13 | |
| VLAA-GUI w/ Opus 4.6Step Budget=152026.04 | 83.3 | 60.65 | 66.38 | 79.59 | 55.9 | 64.75 | |
| VLAA-GUI w/ Gemini 3 FlashStep Budget=502026.04 | 83.3 | 69.19 | 62.75 | 62.49 | 51 | 63.14 | |
| VLAA-GUI w/ Gemini 3.1 ProStep Budget=502026.04 | 83.3 | 71.51 | 67.32 | 67.35 | 55.9 | 66.8 | |
| VLAA-GUI w/ Sonnet 4.6Step Budget=502026.04 | 83.3 | 79.23 | 69.24 | 57.13 | 66.7 | 71.11 | |
| VLAA-GUI w/ Opus 4.6Step Budget=502026.04 | 83.3 | 78.6 | 72.6 | 83.67 | 61.3 | 73.85 | |
| VLAA-GUI w/ Gemini 3.1 ProStep Budget=1002026.04 | 83.3 | 76.6 | 73.76 | 73.47 | 62.9 | 72.47 | |
| VLAA-GUI w/ Sonnet 4.6Step Budget=1002026.04 | 83.3 | 79.24 | 69.25 | 57.14 | 68.8 | 71.67 | |
| VLAA-GUI w/ Gemini 3 FlashStep Budget=152026.04 | 79.2 | 29.92 | 54.14 | 57.13 | 34 | 43.15 | |
| GTA1 w/ GPT-5Step Budget=1002026.04 | 79.17 | 63.91 | 62.56 | 79.59 | 50.91 | 63.41 | |
| OS-Symphony w/ GPT-5Step Budget=1002026.04 | 79.17 | 65.73 | 67.76 | 69.23 | 57.98 | 65.84 | |
| EvoCUAStep Budget=502026.04 | 78.26 | 59.71 | 64.55 | 81.63 | 27.89 | 56.73 | |
| Agent S3 w/ GPT-5Step Budget=1002026.04 | 77.5 | 66.46 | 61.23 | 69.8 | 51.37 | 62.63 | |
| OS-Symphony w/ GPT-5Step Budget=502026.04 | 75 | 64.85 | 61.19 | 69.23 | 54.86 | 63.61 | |
| CoAct-1 w/ GPT-5Step Budget=1002026.04 | 75 | 62.93 | 57.94 | 71.43 | 47.87 | 59.93 | |
| Agent S3 w/ Opus 4.5Step Budget=1002026.04 | 75 | 76.06 | 67.51 | 59.18 | 59 | 67.46 | |
| UiPath w/ GPT-5Step Budget=502026.04 | 73.91 | 49.52 | 62.12 | 71.43 | 37.3 | 53.69 | |
| Kimi K2.5Step Budget=1002026.04 | 73.91 | 69.11 | 66.42 | 63.47 | 46.11 | 63.34 | |
| CoACT-1 w/ GPT-5Step Budget=502026.04 | 70.83 | 60.65 | 54.09 | 69.39 | 42.37 | 56.39 | |
| Claude-Sonnet-4.5Step Budget=1002026.04 | 70.83 | 72.59 | 61.35 | 63.27 | 49.54 | 62.84 | |
| UiPath w/ Opus 4.5Step Budget=1002026.04 | 70.83 | 74.13 | 68.33 | 73.47 | 52.97 | 67.14 | |
| Seed-1.8Step Budget=1002026.04 | 66.67 | 68.8 | 67.05 | 71.43 | 42.38 | 61.87 | |
| DeepMiner-Mano-72BStep Budget=1002026.04 | 66.67 | 63.22 | 52.51 | 83.67 | 24.41 | 53.91 | |
| OpenCUA-72BStep Budget=1002026.04 | 61.13 | 44.73 | 49.95 | 72.58 | 22.16 | 44.91 |