OS agent GUI interaction on VeriOS-Bench
47.62MC ScoreVeriOS-Agent
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| VeriOS-AgentModel Size=32B, Training Protocol=RL2025.09 | 47.62 | 73.21 | 84.09 | 94.12 | 70.12 | 73.83 | |
| VeriOS-AgentModel Size=7B, Training Protocol=RL2025.09 | 46.43 | 71.43 | 79.55 | 81.48 | 48.17 | 65.41 | |
| VeriOS-AgentModel Size=7B, Training Protocol=SFT2025.09 | 45.24 | 71.43 | 77.27 | 81.48 | 47.56 | 57.22 | |
| VeriOS-AgentModel Size=32B, Training Protocol=SFT2025.09 | 45.24 | 71.43 | 81.82 | 92.95 | 69.51 | 68.98 | |
| UI-TARS-1.5Model Size=7B2025.09 | 23.81 | 14.29 | 59.09 | 62.96 | 58.54 | 48.13 | |
| GLM-4.5V2025.09 | 23.81 | 21.43 | 50 | 77.78 | 63.41 | 51.87 | |
| UI-TARSModel Size=7B, Training Protocol=SFT2025.09 | 21.43 | 21.43 | 59.09 | 70.37 | 59.76 | 49.73 | |
| OS-Atlas-ProModel Size=7B2025.09 | 19.05 | 7.14 | 22.73 | 59.26 | 64.63 | 44.39 | |
| UI-TARSModel Size=7B, Training Protocol=DPO2025.09 | 19.05 | 14.29 | 54.55 | 70.37 | 63.41 | 49.73 | |
| UI-TARSModel Size=2B, Training Protocol=SFT2025.09 | 16.67 | 14.29 | 45.45 | 66.67 | 41.46 | 37.97 | |
| Qwen2.5-VLModel Size=72B2025.09 | 16.67 | 21.43 | 50 | 77.78 | 71.95 | 54.01 | |
| GUI-OwlModel Size=32B2025.09 | 14.29 | 14.29 | 54.55 | 70.37 | 69.51 | 51.34 | |
| GPT-4o2025.09 | 14.29 | 7.14 | 31.82 | 81.48 | 48.78 | 40.64 | |
| Qwen-VL-max2025.09 | 11.9 | 14.29 | 4.55 | 18.52 | 26.83 | 18.72 | |
| Qwen2.5-VLModel Size=32B2025.09 | 9.52 | 14.29 | 36.36 | 77.78 | 60.98 | 45.45 | |
| Qwen2.5-VLModel Size=7B2025.09 | 2.38 | 0 | 0 | 44.44 | 37.8 | 23.53 | |
| Qwen2.5-VLModel Size=3B2025.09 | 0 | 0 | 22.73 | 7.41 | 3.66 | 5.35 |