GUI Action Execution on GUI-EDA
71Acoustic Score (COMSOL)EDAgent
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| EDAgentResolution=Dynamic, Agent Category=GUI Agent2025.12 | 71 | 75 | 73 | 62 | 46 | 76 | 58 | 0.598 | |
| EDAgentResolution=Original, Agent Category=GUI Agent2025.12 | 66 | 72 | 74 | 47 | 37 | 73 | 51 | — | |
| Human (expert)Resolution=Dynamic, Agent Category=Human2025.12 | 55 | 62 | 64 | 49 | 31 | 38 | 36 | 0.459 | |
| Aguvis-7BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 53 | 58 | 51 | 36 | 26 | 59 | 44 | 0.394 | |
| Human (expert)Resolution=Original, Agent Category=Human2025.12 | 52 | 61 | 62 | 46 | 24 | 32 | 28 | — | |
| CogAgent-9BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 52 | 45 | 55 | 35 | 21 | 51 | 44 | 0.345 | |
| OSAtlasPro-7BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 51 | 50 | 59 | 37 | 23 | 40 | 32 | 0.347 | |
| Aria-18BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 49 | 38 | 51 | 31 | 29 | 54 | 42 | 0.33 | |
| UITARS-7BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 43 | 37 | 45 | 34 | 23 | 47 | 38 | 0.346 | |
| UITARS-7BResolution=Original, Agent Category=GUI Agent2025.12 | 42 | 30 | 42 | 29 | 12 | 47 | 37 | — | |
| Aguvis-7BResolution=Original, Agent Category=GUI Agent2025.12 | 40 | 56 | 48 | 24 | 17 | 49 | 33 | — | |
| Aria-18BResolution=Original, Agent Category=GUI Agent2025.12 | 34 | 24 | 44 | 9 | 19 | 47 | 38 | — | |
| OSAtlasPro-7BResolution=Original, Agent Category=GUI Agent2025.12 | 32 | 36 | 50 | 29 | 18 | 36 | 23 | — | |
| CogAgent-9BResolution=Original, Agent Category=GUI Agent2025.12 | 32 | 22 | 38 | 18 | 12 | 42 | 37 | — | |
| Human (average)Resolution=Dynamic, Agent Category=Human2025.12 | 27 | 18 | 21 | 26 | 13 | 17 | 14 | 0.166 | |
| Qwen2VL-72BResolution=Dynamic, Agent Category=MLLM2025.12 | 27 | 23 | 29 | 25 | 14 | 26 | 19 | 0.149 | |
| OSAtlas-7BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 25 | 20 | 31 | 19 | 14 | 36 | 23 | 0.214 | |
| Show-2BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 21 | 13 | 19 | 14 | 13 | 35 | 17 | 0.151 | |
| OSAtlas-7BResolution=Original, Agent Category=GUI Agent2025.12 | 20 | 14 | 28 | 14 | 9 | 38 | 17 | — | |
| Human (average)Resolution=Original, Agent Category=Human2025.12 | 20 | 10 | 14 | 22 | 10 | 12 | 11 | — | |
| Qwen25VL-72BResolution=Dynamic, Agent Category=MLLM2025.12 | 19 | 20 | 21 | 18 | 18 | 25 | 17 | 0.131 | |
| Show-2BResolution=Original, Agent Category=GUI Agent2025.12 | 16 | 8 | 16 | 6 | 9 | 35 | 8 | — | |
| InternVL25-78BResolution=Dynamic, Agent Category=MLLM2025.12 | 16 | 15 | 16 | 17 | 8 | 14 | 6 | 0.075 | |
| SeeClick-7BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 14 | 14 | 19 | 13 | 12 | 24 | 15 | 0.087 | |
| Gemini-apiResolution=Dynamic, Agent Category=MLLM2025.12 | 12 | 9 | 15 | 15 | 13 | 24 | 8 | 0.093 | |
| Ovis2-34BResolution=Dynamic, Agent Category=MLLM2025.12 | 11 | 7 | 9 | 8 | 6 | 11 | 6 | 0.05 | |
| LLama3-90BResolution=Dynamic, Agent Category=MLLM2025.12 | 10 | 5 | 12 | 6 | 8 | 14 | 6 | 0.058 | |
| InternVL25-38BResolution=Dynamic, Agent Category=MLLM2025.12 | 9 | 10 | 5 | 8 | 6 | 9 | 6 | 0.051 | |
| OSGenesis-AC-7BResolution=Original, Agent Category=GUI Agent2025.12 | 8 | 8 | 6 | 4 | 2 | 5 | 4 | — | |
| GPT4o-apiResolution=Dynamic, Agent Category=MLLM2025.12 | 8 | 3 | 7 | 8 | 6 | 8 | 4 | 0.042 | |
| Qwen2VL-7BResolution=Dynamic, Agent Category=MLLM2025.12 | 8 | 3 | 10 | 4 | 5 | 9 | 5 | 0.041 | |
| OSGenesis-AC-7BResolution=Dynamic, Agent Category=GUI Agent2025.12 | 7 | 10 | 8 | 6 | 3 | 12 | 5 | 0.06 | |
| Qwen2VL-72BResolution=Original, Agent Category=MLLM2025.12 | 6 | 8 | 14 | 13 | 5 | 5 | 7 | — | |
| Qwen25VL-72BResolution=Original, Agent Category=MLLM2025.12 | 6 | 4 | 6 | 8 | 7 | 16 | 5 | — | |
| Gemini-apiResolution=Original, Agent Category=MLLM2025.12 | 6 | 6 | 4 | 6 | 7 | 9 | 4 | — | |
| LLama3-90BResolution=Original, Agent Category=MLLM2025.12 | 6 | 2 | 6 | 1 | 2 | 6 | 3 | — | |
| GPT4o-apiResolution=Original, Agent Category=MLLM2025.12 | 6 | 0 | 6 | 2 | 2 | 2 | 1 | — | |
| LLaVA-o-72BResolution=Dynamic, Agent Category=MLLM2025.12 | 6 | 7 | 7 | 7 | 5 | 9 | 3 | 0.037 | |
| Nvlm-70BResolution=Dynamic, Agent Category=MLLM2025.12 | 5 | 5 | 3 | 6 | 6 | 11 | 3 | 0.031 | |
| InternVL25-38BResolution=Original, Agent Category=MLLM2025.12 | 4 | 4 | 0 | 3 | 2 | 3 | 4 | — | |
| Qwen2VL-7BResolution=Original, Agent Category=MLLM2025.12 | 4 | 0 | 6 | 2 | 3 | 2 | 2 | — | |
| Claude-apiResolution=Original, Agent Category=MLLM2025.12 | 4 | 0 | 0 | 1 | 0 | 2 | 1 | — | |
| Claude-apiResolution=Dynamic, Agent Category=MLLM2025.12 | 4 | 3 | 7 | 3 | 4 | 10 | 4 | 0.031 | |
| MPlugOwl3-7BResolution=Dynamic, Agent Category=MLLM2025.12 | 3 | 2 | 3 | 3 | 3 | 6 | 2 | 0.015 | |
| Janus-7BResolution=Dynamic, Agent Category=MLLM2025.12 | 3 | 3 | 2 | 1 | 2 | 2 | 1 | 0.009 | |
| SeeClick-7BResolution=Original, Agent Category=GUI Agent2025.12 | 2 | 0 | 0 | 1 | 1 | 6 | 3 | — | |
| InternVL25-78BResolution=Original, Agent Category=MLLM2025.12 | 2 | 4 | 4 | 3 | 2 | 5 | 3 | — | |
| LLaVA-o-72BResolution=Original, Agent Category=MLLM2025.12 | 2 | 2 | 2 | 2 | 2 | 0 | 1 | — | |
| Nvlm-70BResolution=Original, Agent Category=MLLM2025.12 | 2 | 2 | 0 | 0 | 3 | 2 | 1 | — | |
| InternVL2-7BResolution=Original, Agent Category=MLLM2025.12 | 2 | 0 | 0 | 1 | 0 | 0 | 0 | — | |
| Random GuessResolution=Dynamic, Agent Category=Basline2025.12 | 2 | 2 | 2 | 2 | 1 | 2 | 1 | 0.009 | |
| Phi35-7BResolution=Dynamic, Agent Category=MLLM2025.12 | 2 | 1 | 1 | 1 | 1 | 3 | 2 | 0.008 | |
| InternVL2-7BResolution=Dynamic, Agent Category=MLLM2025.12 | 1 | 0 | 1 | 3 | 1 | 3 | 1 | 0.01 | |
| Ovis2-34BResolution=Original, Agent Category=MLLM2025.12 | 0 | 2 | 2 | 4 | 4 | 2 | 3 | — | |
| MPlugOwl3-7BResolution=Original, Agent Category=MLLM2025.12 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | — | |
| LLaVA-Next-7BResolution=Original, Agent Category=MLLM2025.12 | 0 | 0 | 2 | 0 | 2 | 2 | 1 | — | |
| LLaVA-Next-7BResolution=Dynamic, Agent Category=MLLM2025.12 | 0 | 3 | 3 | 3 | 2 | 3 | 1 | 0.014 | |
| Random GuessResolution=Original, Agent Category=Basline2025.12 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | |
| Janus-7BResolution=Original, Agent Category=MLLM2025.12 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | — | |
| Phi35-7BResolution=Original, Agent Category=MLLM2025.12 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | — |