Mobile GUI Task Execution on A3
84.8ESARUI-KOBE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| UI-KOBEAgent Type=Our (Proposed), Size / Model=Qwen3.5-Plus2026.05 | 84.8 | 78 | |
| UI-KOBEAgent Type=Our (Proposed), Size / Model=Qwen3.5-9B2026.05 | 75.7 | 67 | |
| UI-KOBEAgent Type=Our (Proposed), Size / Model=Qwen3.5-4B2026.05 | 71.5 | 61 | |
| Qwen3.5-plusAgent Type=Single Model, Size / Model=397B2026.05 | 67.9 | 52 | |
| T3AAgent Type=Agentic Framework, Size / Model=Gemini-2.5-pro2026.05 | 66.4 | 53 | |
| Qwen3.5Agent Type=Single Model, Size / Model=9B2026.05 | 51.7 | 31 | |
| Qwen3-VLAgent Type=Single Model, Size / Model=30B-A3B2026.05 | 45.6 | 27 | |
| Qwen3.5Agent Type=Single Model, Size / Model=4B2026.05 | 43.7 | 26 | |
| Mobile-UseAgent Type=Agentic Framework, Size / Model=Qwen2.5-VL-7B2026.05 | 39.5 | 16 | |
| Qwen3-VLAgent Type=Single Model, Size / Model=8B2026.05 | 38.2 | 17 | |
| UI-GenieAgent Type=Single Model, Size / Model=7B2026.05 | 32.1 | 13 | |
| GUI-OWLAgent Type=Single Model, Size / Model=7B2026.05 | 32 | 14 | |
| UI-VenusAgent Type=Single Model, Size / Model=7B2026.05 | 32 | 20 | |
| T3AAgent Type=Agentic Framework, Size / Model=Qwen2.5-VL-7B2026.05 | 30.7 | 15 | |
| UI-TARS-1.5Agent Type=Single Model, Size / Model=7B2026.05 | 28.2 | 12 | |
| Qwen2.5-VLAgent Type=Single Model, Size / Model=7B2026.05 | 14.2 | 3 |