Visual Spatial Reasoning on What's Up (Split A)
100AccuracyHuman Estimate
Evaluation results
| Method | Links | |
|---|---|---|
| Human Estimate2025.04 | 100 | |
| SpaRE-7BModel size=7B2025.04 | 100 | |
| GPT-4o2025.04 | 100 | |
| Qwen2VL-7BModel size=7B2025.04 | 99.5 | |
| LLaVA-NeXT-8BModel size=8B2025.04 | 93.6 | |
| SpaRE-2BModel size=2B2025.04 | 93.4 | |
| InternVL2-2BModel size=2B2025.04 | 86.8 | |
| InternVL2-8BModel size=8B2025.04 | 79.2 | |
| MiniCPM-V 4.5Prompting Strategy=General2026.01 | 78.6 | |
| SpaceLLaVa2025.04 | 75.5 | |
| GPT-4o-mini2025.04 | 75 | |
| InternVL3.5 8BPrompting Strategy=Task-Aware2026.01 | 64.8 | |
| InternVL3.5 8BPrompting Strategy=General2026.01 | 63.3 | |
| XVLM 16M2026.01 | 50.7 | |
| Qwen2VL-2BModel size=2B2025.04 | 44.6 | |
| BLIP 14M2026.01 | 38.8 | |
| MiniCPM-V 4.5Prompting Strategy=Task-Aware2026.01 | 36.7 | |
| CLIP-ViT-B/322026.01 | 31.3 | |
| Random2025.04 | 25 | |
| Random2026.01 | 25 |