Mobile UI Task Completion on AndroidControl
50.7Scroll Action PercentageMobile-Aptus
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Mobile-AptusSource=Open2026.05 | 50.7 | 88.89 | 81.27 | 81.82 | 54.11 | 89.46 | 85.13 | 91.64 | 75.81 | 40.12 | |
| GUI-owl-7BSource=Open2026.05 | 42.94 | 57.73 | 69.63 | 84.43 | 60.94 | 85.76 | 78.32 | 75.61 | 57.84 | 20.05 | |
| Qwen3-VL-8BSource=Open2026.05 | 28.16 | 49.85 | 35.27 | 89.04 | 61.41 | 83.39 | 73.58 | 73.8 | 54.2 | 17.3 | |
| Auto-UISource=Open2026.05 | 23.24 | 0 | 0 | 1.32 | 0 | 0 | 0 | 16.28 | 4.12 | 0 | |
| GPT-4oSource=Closed2026.05 | 18.21 | 0 | 13.16 | 36.12 | 21.31 | 15.63 | 34.25 | 61.98 | 27.62 | 5.06 | |
| OS-Atlas-Pro-7BSource=Open2026.05 | 6.52 | 0 | 53.62 | 43.56 | 44.3 | 3.29 | 0.58 | 69.22 | 34.28 | 2.46 | |
| Qwen-VL-MAXSource=Closed2026.05 | 1.92 | 0 | 12.37 | 42.28 | 43.99 | 16.42 | 11.11 | 61.07 | 31.28 | 6.16 | |
| GLM-4V-PlusSource=Closed2026.05 | 1.66 | 0 | 0.71 | 24.09 | 21.04 | 36.3 | 7.06 | 61.95 | 19.2 | 2.92 | |
| UI-TARS-1.5-7BSource=Open2026.05 | 0.2 | 27.11 | 26.18 | 92.69 | 54.73 | 85.44 | 47.63 | 83.78 | 43.22 | 12.71 | |
| Qwen2-VL-7BSource=Open2026.05 | 0.08 | 0 | 1.67 | 10.21 | 25.97 | 25.21 | 0 | 40.24 | 9.7 | 0.48 |