Visual Reasoning on VisualProbe (test)
47.2Accuracy (Hard)Mini-o3
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mini-o3Source=Reproduced through available model weights2025.12 | 47.2 | 45.2 | 64.5 | 50.9 | |
| DRIM2025.12 | 45.3 | 48.1 | 69.5 | 53.4 | |
| DeepEyesSource=Reproduced through available model weights2025.12 | 37.8 | 31.3 | 66.7 | 42.3 | |
| GPT-52025.12 | 31.1 | 22 | 57.5 | 33.6 | |
| Gemini 2.5 Pro2025.12 | 29.3 | 36.6 | 53.2 | 39.6 | |
| GLM-9B-DeltaThinkerAlgorithm=DeltaPrompts2026.05 | 20.04 | 21.55 | 50.04 | — | |
| REVisual-R12026.05 | 18.87 | 20.15 | 43.97 | — | |
| Qwen-8B-DeltaThinkerAlgorithm=DeltaPrompts2026.05 | 16.98 | 20.15 | 51.77 | — | |
| GLM-4.1V-9B-Thinking2026.05 | 16.04 | 17.91 | 39.01 | — | |
| Vision-R1-7B2026.05 | 15.47 | 16.4 | 36.03 | — | |
| LLaVA-OneVisionSource=Reported in original or other relevant paper2025.12 | 13.4 | 12.5 | 36.2 | — | |
| Ovis2.5-9B2025.12 | 12.3 | 26.9 | 51.1 | 31 | |
| ARES-RL-7B2026.05 | 11.24 | 18.5 | 38.94 | — | |
| Qwen3-VL-8B-Thinking2026.05 | 10.86 | 13.61 | 34.75 | — | |
| Bee-8B-RL2026.05 | 10.4 | 14.93 | 26.95 | — |