GUI Knowledge Evaluation on GUI Knowledge Benchmark
83.03State ScoreO3
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| O32026.05 | 83.03 | 84.12 | 88.39 | 74.83 | 75.98 | 45.75 | 69.45 | 95.47 | 73.3 | |
| Gemini-2.5-Pro2026.05 | 81.19 | 84.36 | 87.1 | 71.03 | 73.25 | 46.97 | 67.72 | 92.56 | 71.69 | |
| GPT-5-Chat2026.05 | 78.9 | 84.12 | 88.39 | 71.55 | 71.55 | 43.85 | 68.98 | 91.26 | 70.97 | |
| Claude-Sonnet-4.52026.05 | 74.77 | 81.52 | 82.58 | 49.83 | 70.19 | 43.33 | 70.3 | 91.56 | 66.53 | |
| GUI-CIDER-8BParameters=8B2026.05 | 72.61 | 75.83 | 80.13 | 61.55 | 65.42 | 46.45 | 71.81 | 80.58 | 66.51 | |
| Doubao-V-Pro2026.05 | 72.48 | 83.65 | 81.29 | 67.24 | 75.64 | 41.07 | 33.07 | 94.17 | 63.42 | |
| Claude-Sonnet-42026.05 | 70.18 | 78.44 | 78.06 | 41.9 | 62.52 | 42.11 | 65.2 | 94.82 | 62.16 | |
| Qwen2.5-VL-72BParameters=72B2026.05 | 69.27 | 77.49 | 80 | 61.72 | 64.91 | 38.99 | 62.2 | 85.44 | 63.88 | |
| Qwen3-VL-8B-InstructParameters=8B2026.05 | 66.97 | 76.3 | 79.35 | 60.86 | 63.54 | 45.06 | 71.02 | 78.96 | 65.23 | |
| GUI-owl-7BParameters=7B2026.05 | 60.09 | 64.93 | 63.23 | 21.55 | 55.37 | 36.05 | 21.26 | 39.81 | 40.74 | |
| Qwen2.5-VL-7BParameters=7B2026.05 | 53.21 | 67.77 | 60 | 51.72 | 50.6 | 39.34 | 16.22 | 48.87 | 45.16 | |
| UI-TARS-1.5-7BParameters=7B2026.05 | 49.54 | 59.48 | 59.35 | 22.24 | 59.11 | 34.32 | 38.74 | 55.34 | 44.27 | |
| GLM-4.52026.05 | 49.54 | 48.1 | 53.55 | 27.07 | 17.55 | 35.53 | 28.98 | 91.91 | 38.1 |