Mobile GUI Interaction on Android GUI Evaluation Benchmark 500 human-annotated trajectories (test)
78.55AccuracyMobile-R1
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mobile-R1Training Stages=Stage 1, 2, & 32025.06 | 78.55 | 30.6 | 37.4 | 241 | |
| Mobile-R1Training Stages=Stage 1 & 22025.06 | 77.69 | 29.4 | 36 | 255 | |
| Qwen2.5-VL-32BBackbone=Qwen2.5-VL, Parameters=32B2025.06 | 75.9 | 30.4 | — | 280 | |
| Mobile-R1Training Stages=Stage 12025.06 | 75.68 | 24.4 | 29.8 | 280 | |
| GUI-R1-7BParameters=7B2025.06 | 71.72 | 32.6 | — | 298 | |
| AgentCPM-8BParameters=8B2025.06 | 71.65 | 30 | — | 338 | |
| Qwen2.5-VL-7BBackbone=Qwen2.5-VL, Parameters=7B2025.06 | 63.46 | 12.8 | 21.6 | 523 | |
| GUI-R1-3BParameters=3B2025.06 | 61.29 | 12 | — | 461 | |
| UI-R1-3B-EParameters=3B2025.06 | 59.12 | 9.4 | — | 473 | |
| UI-R1-3BParameters=3B2025.06 | 56.13 | 17.2 | — | 451 | |
| Qwen2.5-VL-3BBackbone=Qwen2.5-VL, Parameters=3B2025.06 | 54.49 | 7.2 | 16.33 | 651 |