GUI Perception and Reasoning on MPR-GUI-Bench RU
80.1AUKeye-VL-7B
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Keye-VL-7BModel Category=Open-source LVLMs2025.11 | 80.1 | 82 | 72.1 | 86.6 | 75.7 | 68.3 | 44 | 28 | 61.8 | |
| Gemini-1.5-FlashModel Category=Close-source LVLMs2025.11 | 80.1 | 81.2 | 72.6 | 89.9 | 66.1 | 59.3 | 60 | 48 | 66.9 | |
| Qwen-2.5-VL-7B-InstructModel Category=Open-source LVLMs2025.11 | 77.6 | 86.1 | 76.7 | 89.6 | 77.3 | 75.1 | 72 | 72 | 80.4 | |
| MiniCPM-o 2.6Model Category=Open-source LVLMs2025.11 | 74.6 | 79.5 | 72.3 | 86.6 | 72.4 | 73.8 | 64 | 56 | 70.2 | |
| Intern2.5VL-8BModel Category=Open-source LVLMs2025.11 | 70.2 | 81.4 | 70.4 | 83.3 | 68.3 | 66.9 | 80 | 48 | 69.1 | |
| Gemini-2.5-ProModel Category=Close-source LVLMs2025.11 | 63.4 | 90.4 | 54 | 92.1 | 75.4 | 70.8 | 92 | 80 | 78.3 | |
| CogAgent-9BModel Category=GUI Agents2025.11 | 55.2 | 72.4 | 52.4 | 67.2 | 43.9 | 31.6 | 56 | 52 | 53.8 |