End-to-end GUI Navigation on AndroidWorld
77.6Success RateUI-Venus-1.5-30B-A3B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| UI-Venus-1.5-30B-A3BParams.=30B2026.02 | 77.6 | — | — | |
| UI-Venus-1.5-8BParams.=8B2026.02 | 73.7 | — | — | |
| MAI-UI-32BParams.=32B2026.02 | 73.3 | — | — | |
| Holo2-30B-A3BParams.=30B2026.02 | 71.6 | — | — | |
| Seed1.82026.02 | 70.7 | — | — | |
| MAI-UI-8BParams.=8B2026.02 | 70.7 | — | — | |
| Gemini-2.5-Pro2026.02 | 69.7 | — | — | |
| Step-GUI-8BParams.=8B2026.02 | 67.7 | — | — | |
| GUI-Owl-7BParams.=7B2026.02 | 66.4 | — | — | |
| UI-Venus-1.0-72BParams.=72B2026.02 | 65.9 | — | — | |
| Step-GUI-4BParams.=4B2026.02 | 63.9 | — | — | |
| Qwen3.5-plusContext=Baseline2026.07 | 61.21 | 12.8 | — | |
| Holo2-8BParams.=8B2026.02 | 60.4 | — | — | |
| Task-State Representation (Qwen3.5-plus)Base Model=Qwen3.5-plus, Context=Proposed2026.07 | 57.76 | 13.9 | -3.45 | |
| GLM-4.6VParams.=106B2026.02 | 57 | — | — | |
| UI-Venus-1.5-2BParams.=2B2026.02 | 55.6 | — | — | |
| Task-State Representation (Kimi-k2.5)Base Model=Kimi-k2.5, Context=Proposed2026.07 | 55.17 | 15.8 | 3.45 | |
| Qwen3-VL-30B-A3BParams.=30B2026.02 | 54.3 | — | — | |
| Kimi-k2.5Context=Baseline2026.07 | 51.72 | 15.5 | — | |
| UI-Venus-1.0-7BParams.=7B2026.02 | 49.1 | — | — | |
| MAI-UI-2BParams.=2B2026.02 | 49.1 | — | — | |
| Qwen3-VL-8BParams.=8B2026.02 | 47.6 | — | — | |
| UI-TARS-72BParams.=72B2026.02 | 46.6 | — | — | |
| Qwen3-VL-2BParams.=2B2026.02 | 36.4 | — | — | |
| UI-TARS-1.5-7BParams.=7B2026.02 | 30 | — | — |