GUI Interaction on Complex Scenarios (test)
100Scroll AccuracyOS-Kairos
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OS-KairosAPI=false, Setting=zero-shot2025.02 | 100 | 100 | 100 | 99.85 | 96.33 | 100 | 92.86 | 99.88 | 95.9 | 88.2 | |
| OS-Atlas-Pro-7BAPI=false, Setting=zero-shot2025.02 | 66.67 | 0 | 20 | 97.8 | 62.46 | 99.29 | 63.12 | 95.9 | 61.36 | 14.29 | |
| Auto-UIAPI=false, Setting=zero-shot2025.02 | 44.44 | 0 | 0 | 2.93 | 0.15 | 0 | 0 | 2.81 | 0.59 | 0 | |
| GPT-4oAPI=true, Setting=zero-shot2025.02 | 22.22 | 100 | 46.67 | 86.95 | 74.63 | 93.62 | 90.07 | 87.59 | 76.35 | 39.13 | |
| Qwen2-VL-7BAPI=false, Setting=zero-shot2025.02 | 22.22 | 85.71 | 0 | 37.98 | 15.69 | 55.32 | 42.55 | 40.75 | 20.49 | 0 | |
| GLM-4V-PlusAPI=true, Setting=zero-shot2025.02 | 0 | 0 | 20 | 95.88 | 37.65 | 21.99 | 20.57 | 81.57 | 33.8 | 4.35 | |
| Qwen-VL-MAXAPI=true, Setting=zero-shot2025.02 | 0 | 100 | 92.21 | 51.25 | 38.33 | 96.45 | 92.21 | 58.73 | 46.89 | 29.81 |