GUI Action Prediction on Meta-GUI (test)
99.36Scroll RateOS-Kairos
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OS-KairosAPI=false, setting=zero-shot2025.02 | 99.36 | 100 | 94.73 | 99.81 | 96.66 | 98.83 | 95.32 | 98.49 | 96.36 | 87.71 | |
| Auto-UIAPI=false, setting=zero-shot2025.02 | 60.9 | 0 | 0 | 26.9 | 2.69 | 0 | 0 | 20.02 | 6.45 | 0 | |
| GPT-4oAPI=true, setting=zero-shot2025.02 | 33.97 | 25 | 12.79 | 94.12 | 42.3 | 66.47 | 28.14 | 69.85 | 32.72 | 6.67 | |
| OS-Atlas-Pro-7BAPI=false, setting=zero-shot2025.02 | 16.03 | 0 | 0 | 94.53 | 37.29 | 60.23 | 15.2 | 66.09 | 23.59 | 0.42 | |
| Qwen-VL-MAXAPI=true, setting=zero-shot2025.02 | 14.74 | 40.91 | 1.91 | 70.87 | 37.85 | 74.85 | 45.03 | 54.74 | 27.86 | 15.42 | |
| GLM-4V-PlusAPI=true, setting=zero-shot2025.02 | 0 | 0 | 1.06 | 95.45 | 26.53 | 38.01 | 22.81 | 65.05 | 17.19 | 1.67 | |
| Qwen2-VL-7BAPI=false, setting=zero-shot2025.02 | 0 | 0 | 0.43 | 51.54 | 2.33 | 38.01 | 18.13 | 35.9 | 3.04 | 0.21 |