Spatial Reasoning on MindCube Tiny Around
75.6AccuracyOurs
Evaluation results
| Method | Links | |
|---|---|---|
| OursFeatures=Active, Cog. Map2026.06 | 75.6 | |
| 3DThinkerQwen2.5-VL-3BFeatures=Passive, 3D Rec.2026.06 | 75.2 | |
| MindCubeQwen2.5-VL-3BFeatures=Passive, Cog. Map2026.06 | 68.4 | |
| Claude-4-Sonnet-20250514Features=Passive2026.06 | 47.62 | |
| Random (frequency)Features=–2026.06 | 35.79 | |
| Spatial-MLLMFeatures=Passive, 2D+3D2026.06 | 32.82 | |
| Random (chance)Features=–2026.06 | 30.66 | |
| Qwen2.5-VL-3B-InstructFeatures=Passive2026.06 | 30.34 | |
| GPT-4oFeatures=Passive2026.06 | 29.16 | |
| Space-QwenFeatures=Passive2026.06 | 26.32 | |
| Qwen2.5-VL-7B-InstructFeatures=Passive2026.06 | 21.35 |