GUI planning semantic consistency on GUIGuard-Bench Android 1.0
3.45Android Avg.Gemini-3-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-3-ProCategory=Closed-source VLM2026.01 | 3.45 | |
| Claude-Sonnet-4.5Category=Closed-source VLM2026.01 | 3.44 | |
| GPT-5.2Category=Closed-source VLM2026.01 | 3.33 | |
| Qwen3-VL-235B-A22BCategory=Open-source VLM2026.01 | 2.92 | |
| GUI-Owl-7BCategory=GUI Agent2026.01 | 2.63 | |
| Fara-7BCategory=GUI Agent2026.01 | 2.34 | |
| UI-Tars-1.5-7BCategory=GUI Agent2026.01 | 1.27 |