GUI Navigation and Action on OS World (test)
2,056Success Rate (Avg)ANCHOR
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ANCHORModel=Qwen3-VL-8B, Strategies=ANCHOR2026.02 | 2,056 | 36.37 | 13.79 | 18.52 | 38.46 | 57.14 | — | 26.67 | 18.18 | 37.5 | — | 7.14 | 50 | |
| Qwen3-VL-8BStrategies=Task-Driven2026.02 | 1,775 | 45.45 | 10.34 | 18.52 | 38.46 | 42.85 | — | 23.33 | 27.27 | 25 | — | 5.71 | 25 | |
| Qwen3-VL-8BStrategies=Zero-Shot2026.02 | 1,682 | 27.27 | 6.9 | 14.81 | 30.77 | 42.85 | — | 23.33 | 27.27 | 37.5 | — | 7.14 | 25 | |
| Qwen3-VL-8BStrategies=Human Data2026.02 | 1,635 | 36.37 | 13.79 | 14.81 | 23.07 | 42.85 | — | 13.33 | 36.36 | 37.5 | — | 5.71 | 25 | |
| ANCHORModel=Qwen2.5-VL-7B, Strategies=ANCHOR2026.02 | 794 | 9.09 | 3.45 | 3.7 | 15.38 | 14.29 | — | 10 | 27.27 | 25 | — | 4.29 | 0 | |
| ANCHORModel=GLM4.1V-9B, Strategies=ANCHOR2026.02 | 701 | 0 | 3.45 | 7.41 | 15.38 | 14.29 | — | 10 | 9.09 | 12.5 | — | 2.85 | 12.5 | |
| Qwen2.5-VL-7BStrategies=Task-Driven2026.02 | 561 | 9.09 | 0 | 3.7 | 15.38 | 0 | — | 10 | 18.18 | 12.5 | — | 2.86 | 0 | |
| GLM4.1V-9BStrategies=Task-Driven2026.02 | 514 | 9.09 | 3.45 | 3.7 | 7.69 | 0 | — | 6.67 | 18.18 | 0 | — | 2.86 | 12.5 | |
| GLM4.1V-9BStrategies=Human Data2026.02 | 514 | 9.09 | 0 | 3.7 | 7.69 | 0 | — | 6.67 | 18.18 | 12.5 | — | 4.29 | 0 | |
| Qwen2.5-VL-7BStrategies=Human Data2026.02 | 467 | 9.09 | 0 | 7.41 | 7.69 | 14.29 | — | 6.67 | 0 | 0 | — | 4.29 | 0 | |
| Qwen2.5-VL-7BStrategies=Zero-Shot2026.02 | 93 | 0 | 0 | 0 | 0 | 0 | — | 3.33 | 0 | 0 | — | 1.43 | 0 | |
| Agent Alphabase model=GPT-5.2, action chunking=true2026.02 | 77.29 | 95.83 | 87.23 | 78.72 | 91.3 | 70.58 | — | 67.39 | 100 | 96.15 | — | 59.14 | 80 | |
| Agent s3strategy=bBoN, N=102026.02 | 72.58 | 79.17 | 87.23 | 72.26 | 86.83 | 62.94 | — | 62.96 | 82.61 | 73.08 | — | 63.9 | 73.33 | |
| Human2024.10 | 72.36 | 75 | 61.7 | 80.85 | 73.91 | 70.59 | 46.67 | 78.26 | 73.91 | 73.08 | 73.27 | — | — | |
| UiPath Screen Agent2026.02 | 67.14 | 70.83 | 80.43 | 70.19 | 69.57 | 60.82 | — | 69.48 | 78.26 | 69.23 | — | 52.97 | 73.33 | |
| OS-Symphony2026.02 | 65.77 | 78.26 | 76.6 | 48.81 | 78.13 | 61.53 | — | 62.96 | 78.26 | 80.77 | — | 55.3 | 80 | |
| GBOX Agent2026.02 | 64.22 | 70.83 | 74.47 | 63.74 | 68.18 | 46.29 | — | 62.96 | 91.3 | 76.92 | — | 49.73 | 66.67 | |
| GTA12026.02 | 63.41 | 79.17 | 63.83 | 65.53 | 60.74 | 57.88 | — | 58.61 | 82.61 | 76.92 | — | 50.91 | 80 | |
| claude-sonnet-4-52026.02 | 62.88 | 70.83 | 72.34 | 68 | 82.48 | 58.18 | — | 62.96 | 73.91 | 53.85 | — | 49.54 | 60 | |
| CoACT-12026.02 | 60.76 | 75 | 70.21 | 50.28 | 73.91 | 71.94 | — | 54.26 | 78.26 | 65.38 | — | 47.87 | 73.33 | |
| GLM4.1V-9BStrategies=Zero-Shot2026.02 | 47 | 0 | 0 | 0 | 0 | 0 | — | 3.33 | 0 | 0 | — | 0 | 0 | |
| Claude-sonnet-4-5Type=General, Open source=False2026.05 | 42.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| doubao-1-5-thinking-vision-proType=Specialized, Open source=False2026.05 | 39 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UI-TARS-1.5-7BType=Specialized, Open source=True2026.05 | 24.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OpenCUA-7BType=Specialized, Open source=True2026.05 | 24.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UI-TARS-72B-DPOType=Specialized, Open source=True2026.05 | 24 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lite-GUI-30B-A3BType=Specialized, Open source=True2026.05 | 22.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Opencua-Qwen2-7BType=Specialized, Open source=True2026.05 | 19.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OpenCUA-A3BType=Specialized, Open source=True2026.05 | 16.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-VL-30B-A3B-InstructType=General, Open source=True2026.05 | 16.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-4o + OS-Atlas-Base-7BGrounding Module=OS-Atlas-Base-7B, Backbone Model=Qwen2-VL-7B2024.10 | 14.63 | 25 | 4.26 | 17.02 | 8.7 | 29.41 | 26.67 | 19.57 | 17.39 | 19.23 | 8.91 | — | — | |
| Lite-GUI-2BType=Specialized, Open source=True2026.05 | 13.24 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-4o + OS-Atlas-Base-4BGrounding Module=OS-Atlas-Base-4B, Backbone Model=InternVL-2-4B2024.10 | 11.65 | 20.83 | 2.23 | 14.89 | 8.7 | 23.52 | 13.33 | 15.22 | 13.04 | 15.38 | 7.92 | — | — | |
| Kimi-VL-A3BType=General, Open source=True2026.05 | 9.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-4o + SeeClickGrounding Module=SeeClick2024.10 | 9.21 | 16.67 | 0 | 12.76 | 4.35 | 23.52 | 6.67 | 10.86 | 8.7 | 11.54 | 7.92 | — | — | |
| GPT-o3Type=General, Open source=False2026.05 | 9.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-VL-2B-InstructType=General, Open source=True2026.05 | 6.04 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-4oGrounding Module=Native/Internal2024.10 | 5.03 | 8.33 | 0 | 6.77 | 4.35 | 16.1 | 0 | 4.35 | 4.35 | 3.85 | 5.58 | — | — | |
| GPT-4o + SoMGrounding Module=Set-of-Mark (SoM)2024.10 | 4.59 | 20.83 | 0 | 6.77 | 4.35 | 6.52 | 0 | 4.35 | 4.35 | 0 | 3.6 | — | — | |
| Qwen2.5-VL-72B-instructType=General, Open source=True2026.05 | 4.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VL-32B-instructType=General, Open source=True2026.05 | 3 | — | — | — | — | — | — | — | — | — | — | — | — |