GUI Navigation and Task Execution on macOSWorld
58.62File Success RateGemini 3 Flash
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Gemini 3 FlashSkill condition=MMSkills2026.05 | 58.62 | 50 | 77.14 | 65.52 | 65.73 | 65.73 | |
| GLM-5VSkill condition=MMSkills2026.05 | 44.83 | 66.67 | 48.57 | 58.62 | 50 | 51.75 | |
| Gemini 3 FlashSkill condition=No skill2026.05 | 41.38 | 33.33 | 60 | 62.07 | 55.79 | 55.94 | |
| Qwen3-VL-235BSkill condition=MMSkills2026.05 | 37.93 | 33.33 | 54.29 | 62.07 | 57.89 | 51.75 | |
| Qwen3-VL-235BSkill condition=Text-only2026.05 | 34.48 | 33.33 | 37.14 | 51.72 | 52.63 | 43.36 | |
| Gemini 3 FlashSkill condition=Text-only2026.05 | 31.03 | 25 | 62.86 | 75.86 | 55.26 | 53.85 | |
| Qwen3-VL-235BSkill condition=No skill2026.05 | 31.03 | 58.33 | 51.43 | 58.62 | 44.74 | 47.55 | |
| GLM-5VSkill condition=Text-only2026.05 | 31.03 | 66.67 | 62.86 | 58.62 | 47.37 | 51.75 | |
| GLM-5VSkill condition=No skill2026.05 | 24.14 | 16.67 | 40 | 41.38 | 39.47 | 34.97 | |
| Qwen3-VL-8B-InstructSkill condition=No skill2026.05 | 10.34 | 0 | 14.29 | 3.45 | 0 | 6.29 | |
| Qwen3-VL-8B-InstructSkill condition=MMSkills2026.05 | 6.9 | 8.33 | 8.57 | 3.45 | 5.26 | 6.29 | |
| Qwen3-VL-8B-InstructSkill condition=Text-only2026.05 | 0 | 8.33 | 2.86 | 3.45 | 10.53 | 4.9 |