GUI Automation on AITW Gen
19.5PGUI-S1-7B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| UI-S1-7BCategory=Open-src, Scale=7B/8B2026.04 | 19.5 | 4.6 | |
| Gemini-3-flashCategory=Closed-source2026.04 | 17.8 | 4.5 | |
| UI-TARS-7BCategory=Open-src, Scale=7B/8B2026.04 | 16.8 | 5.9 | |
| VeriGUI-7BCategory=Ours, Scale=7B2026.04 | 15.5 | 5.5 | |
| OS-Atlas-7BCategory=Open-src, Scale=7B/8B2026.04 | 12.3 | 3.4 | |
| AgentCPM-GUI-8BCategory=Open-src, Scale=7B/8B2026.04 | 12 | 3.4 | |
| Qwen2.5-VL-7BCategory=Open-src, Scale=7B/8B2026.04 | 11.7 | 3 | |
| GPT-5.1Category=Closed-source2026.04 | 10.4 | 2.5 | |
| UI-R1-3BCategory=Open-src, Scale=3B2026.04 | 8.8 | 2.4 | |
| VeriGUI-3BCategory=Ours, Scale=3B2026.04 | 7.4 | 2.6 | |
| OS-Genesis-7BCategory=Open-src, Scale=7B/8B2026.04 | 6.5 | 2.2 | |
| Qwen2.5-VL-3BCategory=Open-src, Scale=3B2026.04 | 1.5 | 0.1 |