Mobile UI Reasoning on AMEX
76.2Gmail AccuracyCoME
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| CoME#Params=5B2026.02 | 76.2 | 72.6 | 81 | 64.3 | 81.2 | 63.2 | 72.6 | 78.4 | 66.9 | 72.61 | |
| OS-Atlas#Params=7B2026.02 | 74.4 | 69.7 | 74.6 | 64 | 80.7 | 63.6 | 65.3 | 83.3 | 62.3 | 69.99 | |
| UGround#Params=7B2026.02 | 70.9 | 68.8 | 72.7 | 63.7 | 77.7 | 67.7 | 73.7 | 80.1 | 67.6 | 69.12 | |
| UITars#Params=7B2026.02 | 67.7 | 70 | 71.8 | 63.8 | 71.5 | 67.7 | 77 | 86.4 | 72.8 | 70.33 | |
| Qwen2VL-MoE#Params=3B, hybrid-capabilities reasoning finetuned=true2026.02 | 65.1 | 63.7 | 57.8 | 63 | 78 | 60.3 | 70.2 | 76.5 | 61.1 | 64.56 | |
| AriaUI#Params=3.9B2026.02 | 63.1 | 62.3 | 68.5 | 58.9 | 83 | 54.7 | 62.5 | 83.3 | 66.9 | 64.1 | |
| SphAgent#Params=7B, reported_from=Chai et al., 20242026.02 | 61.7 | 68.2 | 77.7 | 72 | 71.9 | 64.6 | 79.6 | 71.3 | 69.6 | 70.71 | |
| UITars#Params=2B2026.02 | 59.4 | 47.9 | 55.4 | 53 | 65.1 | 62.3 | 64.7 | 61.7 | 58.1 | 54.43 | |
| Qwen2VL#Params=7B, hybrid-capabilities reasoning finetuned=true2026.02 | 57.6 | 58.4 | 56.5 | 47.3 | 64.2 | 66.3 | 60.9 | 72.8 | 54.8 | 57.99 | |
| ShowUI#Params=2B2026.02 | 52.2 | 33.6 | 68.8 | 55.3 | 51.8 | 57.4 | 51.9 | 69.7 | 50.2 | 47.74 | |
| UI-S1#Params=7B2026.02 | 47.3 | 62.2 | 66 | 54.1 | 38.1 | 75.3 | 72.7 | 80.2 | 63.6 | 60.57 | |
| DeepSeekVL2#Params=4.5B, hybrid-capabilities reasoning finetuned=true2026.02 | 43.1 | 36.9 | 52.5 | 42.2 | 42.7 | 51.1 | 47 | 61.7 | 38.9 | 42.22 | |
| MolmoE#Params=1B, hybrid-capabilities reasoning finetuned=true2026.02 | 38.7 | 28.6 | 28.1 | 27.2 | 45.3 | 22.8 | 37.6 | 38.2 | 34 | 31.56 | |
| Qwen2VL#Params=2B, hybrid-capabilities reasoning finetuned=true2026.02 | 37.4 | 35.2 | 40.1 | 33.7 | 50 | 47.5 | 41.8 | 56.7 | 40.5 | 38.53 | |
| GUI-R1#Params=3B2026.02 | 37.1 | 50.6 | 58.2 | 47.1 | 21.6 | 54.7 | 54.6 | 56.1 | 54.4 | 48.53 | |
| GUI-R1#Params=3B2026.02 | 36.8 | 53 | 64.6 | 49.4 | 20.6 | 68.6 | 64.5 | 68.5 | 62.3 | 52.47 | |
| SeeClick#Params=7B, reported_from=Chai et al., 20242026.02 | 28.2 | 29.4 | 18.1 | 20 | 30 | 53.1 | 30.7 | 37.1 | 27.4 | 30.44 |