Action Grounding on VWB AG (test)
71.8Grounding AccuracyOS-ATLAS
Evaluation Results
| Method | Links | |
|---|---|---|
| OS-ATLASSize=7B, Type=UI Experts2025.02 | 71.8 | |
| Qwen2-VL-AutoGUI702kSize=7B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 70.9 | |
| UGround-v1-7BSize=7B, Type=UI Experts2025.02 | 69.9 | |
| Qwen2-VLSize=7B, Type=General2025.02 | 62.1 | |
| CogAgentSize=18B, Type=UI Experts2025.02 | 59.2 | |
| SeeClick w/ AutoGUI702kSize=10B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 45.6 | |
| Qwen-VL-AutoGUI702kSize=10B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 35.9 | |
| SeeClickSize=10B, Type=UI Experts2025.02 | 27.2 | |
| SliME-AutoGUI702kSize=8B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 13.6 | |
| GPT-4oSize=N/A, Type=General2025.02 | 6.8 | |
| SliMESize=8B, Type=General2025.02 | 4.9 | |
| Llama-3.2-Vision-InstructSize=11B, Type=General2025.02 | 3.9 | |
| Qwen-VLSize=10B, Type=General2025.02 | 3.9 |