Mobile UI Automation on AndroidControl High (test)
80.3Success Rate (SR)CRAFT-GUI-32B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CRAFT-GUI-32BTraining Stage=stage32025.08 | 80.3 | 91 | 85.8 | |
| CRAFT-GUI-32BTraining Stage=stage22025.08 | 78.7 | 90.8 | 84.4 | |
| CRAFT-GUI-32BTraining Stage=stage12025.08 | 75.6 | 88.7 | 81.9 | |
| UI-TARS-72B2025.08 | 74.7 | 85.2 | 81.5 | |
| OS-Atlas-7B2025.08 | 71.2 | 85.2 | 78.5 | |
| Qwen2-VL-7B2025.08 | 69.7 | 83.8 | 77.7 | |
| Qwen2.5-VL-32B2025.08 | 69.6 | — | — | |
| Qwen2.5-VL-72B2025.08 | 67.4 | — | — | |
| InternVL-2-4B2025.08 | 66.7 | 84.1 | 72.7 | |
| Aguvis-72B2025.08 | 66.4 | — | — | |
| SeeClick2025.08 | 59.1 | 82.9 | 62.9 | |
| GPT-4o2025.08 | 20.8 | 66.3 | 0 | |
| ClaudeVersion=Claude-computer-use2025.08 | 12.5 | 63.7 | 0 | |
| Aria-UI2025.08 | 10.2 | — | 43.2 |