GUI Action Prediction on ScreenDrag offline (test)
99.01Endpoint Acc (OS)OpenCUA-7B
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OpenCUA-7BAction Paradigm=Action as Language, Model Category=Open-source models2025.12 | 99.01 | 4.95 | 0 | 3.96 | 0 | 21.58 | 4.42 | 186.65 | 762.77 | 214.81 | 959.1 | 425.55 | |
| OpenCUA-32BAction Paradigm=Action as Language, Model Category=Open-source models2025.12 | 96.04 | 6.93 | 0 | 0 | 0 | 20.59 | 10.95 | 165.7 | 907.41 | 62.06 | 791.88 | 387.6 | |
| Gemini-2.5-CUAAction Paradigm=Action as Language, Model Category=Proprietary models2025.12 | 84.16 | 11.88 | 0 | 3.96 | 0 | 20 | 12.11 | 121.94 | 508.19 | 114.34 | 0 | 189.15 | |
| Seed-1.6-VisionAction Paradigm=Action as Language, Model Category=Proprietary models2025.12 | 71.29 | 1.98 | 0.99 | 4.95 | 0 | 15.84 | 62.17 | 233.92 | 467.09 | 81.64 | 824.55 | 333.87 | |
| Qwen3-VL-32BAction Paradigm=Action as Language, Model Category=Open-source models2025.12 | 71.29 | 1.98 | 0.99 | 0 | 0 | 14.85 | 149.77 | 212.02 | 527.23 | 236.83 | 646.73 | 354.52 | |
| ShowUI-π-450MAction Paradigm=Flow-based action (Ours)2025.12 | 61.39 | 85.06 | 56.92 | 96.3 | 93.07 | 78.55 | 350.55 | 57.68 | 195.96 | 136.47 | 54.57 | 159.05 | |
| UI-TARS-1.5-7BAction Paradigm=Action as Language, Model Category=Proprietary models2025.12 | 60.4 | 0.99 | 0 | 3.96 | 0 | 13.07 | 224.57 | 235.5 | 564.89 | 172.53 | 703.54 | 380.21 | |
| OperatorAction Paradigm=Action as Language, Model Category=Proprietary models2025.12 | 51.49 | 3.96 | 0 | 0 | 0 | 11.09 | 46.85 | 244.25 | 602 | 0 | 795.58 | 422.17 | |
| Qwen3-VL-8BAction Paradigm=Action as Language, Model Category=Open-source models2025.12 | 8.91 | 1.98 | 0 | 0 | 0 | 2.18 | 660.33 | 228.47 | 532.71 | 257.44 | 662.37 | 468.26 | |
| Qwen3-VL-2BAction Paradigm=Action as Language, Model Category=Open-source models2025.12 | 3.96 | 0 | 0.99 | 0 | 0 | 0.99 | 708.68 | 248.29 | 551.15 | 258.07 | 562.62 | 465.76 |