GUI Automation on AndroidControl High
83.7Task Match (TM)UI-TARS-7B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| UI-TARS-7B2026.04 | 83.7 | 80.5 | 72.5 | — | — | — | — | |
| Gemini-3-flashCategory=Closed-source2026.04 | 83.3 | 36.9 | 42.2 | — | — | — | — | |
| UI-Copilot-7B2026.04 | 82.9 | 72.2 | 71.8 | — | — | — | — | |
| UI-S1-7B2026.04 | 79.9 | 73.4 | 68.2 | — | — | — | — | |
| AgentCPM-GUI-8B2026.04 | 77.7 | — | 69.2 | — | — | — | — | |
| VeriGUI-7BCategory=Ours, Scale=7B2026.04 | 74.2 | 65.5 | 51.1 | 16.7 | 30.6 | 23.5 | 1.09 | |
| UI-R1-7B2026.04 | 72.4 | 62.8 | 54.2 | — | — | — | — | |
| VeriGUI-3BCategory=Ours, Scale=3B2026.04 | 72.2 | 56.4 | 46.6 | 13.3 | 23.3 | 16.7 | 1.25 | |
| UI-TARS-7BCategory=Open-src, Scale=7B/8B2026.04 | 71.9 | 60.6 | 47.7 | 10 | 14.7 | 13.3 | 1.67 | |
| GPT-5.1Category=Closed-source2026.04 | 70.1 | 30 | 23.1 | — | — | — | — | |
| UI-S1-7BCategory=Open-src, Scale=7B/8B2026.04 | 70.1 | 53.6 | 44.5 | 13.3 | 25.4 | 16.7 | 1.33 | |
| Qwen2.5-VL-7BCategory=Open-src, Scale=7B/8B2026.04 | 68.5 | 61.7 | 42.8 | 6.2 | 12.8 | 10.6 | 1.15 | |
| OS-Atlas-7BCategory=Open-src, Scale=7B/8B2026.04 | 67.7 | 42.2 | 35.5 | 0 | 5.5 | 0 | — | |
| GPT-4o (SoM)2026.04 | 66.3 | 0 | 20.8 | — | — | — | — | |
| OS-Genesis-7B2026.04 | 65.9 | — | 44.4 | — | — | — | — | |
| OS-Genesis-7BCategory=Open-src, Scale=7B/8B2026.04 | 64.5 | 47.5 | 35.7 | 0 | 6.5 | 0 | — | |
| UI-Copilot-3B2026.04 | 64.3 | 54.5 | 50.3 | — | — | — | — | |
| Claude-CU (SoM)2026.04 | 63.7 | 0 | 12.5 | — | — | — | — | |
| UI-R1-3BCategory=Open-src, Scale=3B2026.04 | 62.4 | 50.4 | 30.3 | 0 | 4.9 | 0 | — | |
| Qwen2.5VL-7B2026.04 | 62.2 | 72.5 | 52.7 | — | — | — | — | |
| Qwen2.5-VL-3BCategory=Open-src, Scale=3B2026.04 | 60.1 | 52.8 | 31.2 | 0 | 2.8 | 0 | — | |
| UI-R1-3B2026.04 | 57.9 | 55.7 | 45.4 | — | — | — | — | |
| OS-Atlas-7B2026.04 | 57.4 | 54.9 | 29.8 | — | — | — | — | |
| Qwen2.5VL-3B2026.04 | 47.8 | 46.5 | 38.9 | — | — | — | — | |
| Qwen2VL-2B2026.04 | 42.3 | 18.7 | 13.6 | — | — | — | — | |
| AgentCPM-GUI-8BCategory=Open-src, Scale=7B/8B2026.04 | 42.2 | 66.4 | 34.1 | 0 | 7.1 | 0 | — | |
| ShowUI-2B2026.04 | 41.8 | 32.8 | 19.7 | — | — | — | — |