GUI Agent Task Success on AndroidWorld (online)
48.7Task Success RateGPT-5
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5Model Type=Agent Frameworks, Additional Module=UGround-v1-7B, Steps=202026.02 | 48.7 | |
| GUI-Libra-4BModel Type=Native Models (single VLM), Steps=202026.02 | 42.6 | |
| GUI-Libra-8BModel Type=Native Models (single VLM), Steps=202026.02 | 42.6 | |
| GPT-4oModel Type=Agent Frameworks, Additional Module=UGround-v1-7B, Steps=202026.02 | 42.6 | |
| GPT-5-miniModel Type=Agent Frameworks, Additional Module=UGround-v1-7B, Steps=202026.02 | 40.9 | |
| Qwen3-VL-8BModel Type=Agent Frameworks, Additional Module=Step-wise Summary, Steps=202026.02 | 39.1 | |
| GPT-4.1Model Type=Agent Frameworks, Additional Module=UGround-v1-7B, Steps=202026.02 | 37.4 | |
| Qwen3-VL-4BModel Type=Agent Frameworks, Additional Module=Step-wise Summary, Steps=202026.02 | 36.5 | |
| Qwen3-VL-32BModel Type=Native Models (single VLM), Steps=202026.02 | 34.8 | |
| Qwen2.5-VL-72BModel Type=Native Models (single VLM), Steps=202026.02 | 32.2 | |
| ScaleCUA-32BModel Type=Agent Frameworks, Additional Module=Step-wise Summary, Steps=202026.02 | 30.6 | |
| Qwen3-VL-8B (Baseline)Model Type=Native Models (single VLM), Steps=202026.02 | 30.4 | |
| Qwen2.5-VL-32BModel Type=Native Models (single VLM), Steps=202026.02 | 29.6 | |
| GUI-Libra-7BModel Type=Native Models (single VLM), Steps=202026.02 | 29.6 | |
| ScaleCUA-7BModel Type=Agent Frameworks, Additional Module=Step-wise Summary, Steps=202026.02 | 27.2 | |
| Qwen3-VL-4B (Baseline)Model Type=Native Models (single VLM), Steps=202026.02 | 27 | |
| GUI-Libra-3BModel Type=Native Models (single VLM), Steps=202026.02 | 25.2 | |
| ScaleCUA-3BModel Type=Agent Frameworks, Additional Module=Step-wise Summary, Steps=202026.02 | 23.7 | |
| GLM-4.1V-9B-ThinkingModel Type=Agent Frameworks, Additional Module=UGround-v1-7B, Steps=202026.02 | 20.9 | |
| GLM-4.1V-9B-ThinkingModel Type=Native Models (single VLM), Steps=202026.02 | 18.3 | |
| UI-TARS-1.5-7BModel Type=Native Models (single VLM), Steps=202026.02 | 16.5 | |
| Qwen2.5-VL-7BModel Type=Agent Frameworks, Additional Module=Step-wise Summary, Steps=202026.02 | 15.7 | |
| Qwen2.5-VL-7B (Baseline)Model Type=Native Models (single VLM), Steps=202026.02 | 7.8 | |
| Qwen2.5-VL-3BModel Type=Agent Frameworks, Additional Module=Step-wise Summary, Steps=202026.02 | 7 | |
| Qwen2.5-VL-3B (Baseline)Model Type=Native Models (single VLM), Steps=202026.02 | 3.5 |