Element Grounding on MOTIF (test)
78.8Grounding AccuracyOS-ATLAS
Evaluation Results
| Method | Links | |
|---|---|---|
| OS-ATLASSize=7B, Type=UI Experts2025.02 | 78.8 | |
| UGround-v1-7BSize=7B, Type=UI Experts2025.02 | 78.4 | |
| Qwen2-VLSize=7B, Type=General2025.02 | 71.1 | |
| Qwen2-VL-AutoGUI702kSize=7B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 67 | |
| SeeClickSize=10B, Type=UI Experts2025.02 | 66.5 | |
| SeeClick w/ AutoGUI702kSize=10B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 56.2 | |
| CogAgentSize=18B, Type=UI Experts2025.02 | 45.1 | |
| SliME-AutoGUI702kSize=8B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 44.9 | |
| Qwen-VL-AutoGUI702kSize=10B, Type=Finetuned, Training Data=AutoGUI 702k2025.02 | 44 | |
| GPT-4oSize=N/A, Type=General2025.02 | 30.5 | |
| Llama-3.2-Vision-InstructSize=11B, Type=General2025.02 | 19.7 | |
| Qwen-VLSize=10B, Type=General2025.02 | 7.8 | |
| SliMESize=8B, Type=General2025.02 | 7 |