Mobile Task Automation on OS-Kairos
66.67Scroll RateOS-Atlas-Pro-7B
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OS-Atlas-Pro-7BSource=Open2026.05 | 66.67 | 0 | 20 | 97.8 | 62.46 | 99.29 | 63.12 | 95.9 | 61.36 | 14.29 | |
| Mobile-AptusSource=Open2026.05 | 55.56 | 85.71 | 66.67 | 99.27 | 89.15 | 100 | 90.65 | 98.24 | 88.62 | 68.32 | |
| Auto-UISource=Open2026.05 | 44.44 | 0 | 0 | 2.93 | 0.15 | 0 | 0 | 2.81 | 0.59 | 0 | |
| GPT-4oSource=Closed2026.05 | 22.22 | 100 | 46.67 | 86.95 | 74.63 | 93.62 | 90.07 | 87.59 | 76.35 | 39.13 | |
| Qwen2-VL-7BSource=Open2026.05 | 22.22 | 85.71 | 0 | 37.98 | 15.69 | 55.32 | 42.55 | 40.75 | 20.49 | 0 | |
| UI-TARS-1.5-7BSource=Open2026.05 | 9.09 | 0 | 26.67 | 98.53 | 73.97 | 92.91 | 37.59 | 95.2 | 65.34 | 28 | |
| GLM-4V-PlusSource=Closed2026.05 | 0 | 0 | 20 | 95.88 | 37.65 | 21.99 | 20.57 | 81.57 | 33.8 | 4.35 | |
| Qwen-VL-MAXSource=Closed2026.05 | 0 | 100 | 92.21 | 51.25 | 38.33 | 96.45 | 92.21 | 58.73 | 46.89 | 29.81 | |
| Qwen3-VL-8BSource=Open2026.05 | 0 | 0 | 26.67 | 95.88 | 79.56 | 85.11 | 83.69 | 90.63 | 77.28 | 43 | |
| GUI-owl-7BSource=Open2026.05 | 0 | 0 | 20 | 96.32 | 81.32 | 58.87 | 56.74 | 86.65 | 74.36 | 36.5 |