Spatial Reasoning on MindCube (tiny)
94.5AccuracyHuman
Evaluation Results
| Method | Links | |
|---|---|---|
| HumanCategory=Reference2026.05 | 94.5 | |
| ProSRDescription=QWEN3-VL-8B-THINKING + Ours2026.05 | 88.6 | |
| OursFeatures=Active, Cog. Map2026.06 | 85 | |
| GeoThinkerCategory=Open-source Spatial Intelligence Models2026.05 | 83 | |
| 3DThinkerQwen2.5-VL-3BFeatures=Passive, 3D Rec.2026.06 | 81.8 | |
| OursFeatures=Active, Cog. Map2026.06 | 81 | |
| OursFeatures=Active, Cog. Map2026.06 | 80.5 | |
| MindCubeQwen2.5-VL-3BFeatures=Passive, Cog. Map2026.06 | 79.2 | |
| QWEN3-VL-8B-THINKING + GRPOMethod Variant=Vanilla GRPO2026.05 | 75.8 | |
| 3DThinkerQwen2.5-VL-3BFeatures=Passive, 3D Rec.2026.06 | 75.2 | |
| SenseNova-SI-1.1-Qwen3-VL-8BCategory=Open-source Spatial Intelligence Models2026.05 | 73.8 | |
| Gemini 3 ProCategory=Proprietary Models2026.05 | 70.9 | |
| SenseNova-U1Parameters=30BA3B, Internal Reasoning (Think mode)=true2026.05 | 70.86 | |
| MindCubeQwen2.5-VL-3BFeatures=Passive, Cog. Map2026.06 | 70.7 | |
| QWEN3-VL-8B-THINKING + SFTMethod Variant=SFT Only2026.05 | 68.4 | |
| Qwen3.5Parameters=35BA3B, Internal Reasoning (Think mode)=false2026.05 | 63.46 | |
| SenseNova-U1Parameters=8B, Internal Reasoning (Think mode)=true2026.05 | 62.01 | |
| GPT-3.2Category=Proprietary Models2026.05 | 60.4 | |
| Gemini 2.5 ProCategory=Proprietary Models2026.05 | 57.6 | |
| Qwen3.5Parameters=9B, Internal Reasoning (Think mode)=false2026.05 | 57.59 | |
| 3DThinkerQwen2.5-VL-3BFeatures=Passive, 3D Rec.2026.06 | 55.5 | |
| Gemma4Parameters=26BA4B, Internal Reasoning (Think mode)=false2026.05 | 48.84 | |
| Seed 1.6Category=Proprietary Models2026.05 | 48.8 | |
| Claude-4-Sonnet-20250514Features=Passive2026.06 | 48.42 | |
| MindCubeQwen2.5-VL-3BFeatures=Passive, Cog. Map2026.06 | 48 | |
| SpatialThinker-30BEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB, Training Dataset=STVQA-7K2025.11 | 45.4 | |
| SpatialThinker-7BEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB, Training Dataset=STVQA-7K2025.11 | 45.1 | |
| Claude-4-Sonnet-0514Evaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 44.8 | |
| Claude-4-Sonnet-20250514Features=Passive2026.06 | 44.75 | |
| Claude-4-Sonnet-20250514Features=Passive2026.06 | 44.21 | |
| Qwen2.5-VL-7B + Vanilla GRPOEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB, Training Dataset=STVQA-7K2025.11 | 44 | |
| SpatialLadder-3BCategory=Open-source Spatial Intelligence Models2026.05 | 43.5 | |
| Qwen3VLParameters=8B, Internal Reasoning (Think mode)=true2026.05 | 43.17 | |
| GPT-5-0807Evaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 42.5 | |
| Qwen2.5-VL-7B + SFTEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB, Training Dataset=STVQA-7K2025.11 | 42.2 | |
| Qwen3VLParameters=30BA3B, Internal Reasoning (Think mode)=true2026.05 | 40.86 | |
| Qwen3-VL-8B-ThinkingCategory=Open-source General Models2026.05 | 40.6 | |
| SpatialThinker-3BEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB, Training Dataset=STVQA-7K2025.11 | 40.5 | |
| InternVL3.5-8BCategory=Open-source General Models2026.05 | 40.2 | |
| GPT-4oFeatures=Passive2026.06 | 40.17 | |
| VST-7B-SFTCategory=Open-source Spatial Intelligence Models2026.05 | 39.7 | |
| Argos2025.12 | 39.6 | |
| Qwen3-VL-30BEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 39 | |
| GPT-4oFeatures=Passive2026.06 | 38.81 | |
| Qwen2.5-VL-3B + Vanilla GRPOEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB, Training Dataset=STVQA-7K2025.11 | 38.8 | |
| Qwen2.5-VL-7B-InstructFeatures=Passive2026.06 | 38.76 | |
| Spatial-MLLMFeatures=Passive, 2D+3D2026.06 | 38.39 | |
| Random (frequency)Features=–2026.06 | 38.3 | |
| Space-QwenFeatures=Passive2026.06 | 38.02 | |
| SpaceR-SFT-7BCategory=Open-source Spatial Intelligence Models2026.05 | 38 | |
| Cambrian-S-7BCategory=Open-source Spatial Intelligence Models2026.05 | 37.9 | |
| Qwen2.5-VL-3B-InstructFeatures=Passive2026.06 | 37.37 | |
| VLAA-Thinker-7BEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 36.7 | |
| Qwen2.5-VL-3BEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 36.4 | |
| Random (chance)Features=–2026.06 | 36.36 | |
| Qwen2.5-VL-7B-InstructCategory=Open-source General Models2026.05 | 36 | |
| SpaceThinkerEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 36 | |
| SATORI-R1Evaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 36 | |
| Visionary-R1Evaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 36 | |
| Qwen2.5-VL-3B + SFTEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB, Training Dataset=STVQA-7K2025.11 | 35.9 | |
| Qwen2.5-VL-7BEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 35.3 | |
| Qwen2.5VL 7B2025.12 | 34.9 | |
| GPT-4o-0513Evaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 34.9 | |
| BAGEL-7B-MoTCategory=Open-source General Models2026.05 | 34.7 | |
| SpatialReasonerEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 34.6 | |
| Video-R1Training Protocol=SFT2025.12 | 34.2 | |
| Space-QwenFeatures=Passive2026.06 | 33.71 | |
| SpaceOmEvaluation Setting=Zero-shot, Decoding=Greedy, Input Modality=RGB2025.11 | 33.5 | |
| Space-QwenFeatures=Passive2026.06 | 33.28 | |
| Qwen2.5-VL-3B-InstructFeatures=Passive2026.06 | 33.26 | |
| Qwen2.5-VL-3B-InstructFeatures=Passive2026.06 | 33.21 | |
| Qwen2.5VL 7BPrompting Strategy=CoT2025.12 | 33.1 | |
| Random (frequency)Features=–2026.06 | 33.02 | |
| Random ChoiceCategory=Reference2026.05 | 33 | |
| Random (frequency)Features=–2026.06 | 32.66 | |
| GPT-4oFeatures=Passive2026.06 | 32.65 | |
| Random (chance)Features=–2026.06 | 32.35 | |
| Random (chance)Features=–2026.06 | 32.29 | |
| Spatial-MLLMFeatures=Passive, 2D+3D2026.06 | 32.06 | |
| Video-R1Training Protocol=RL2025.12 | 31.9 | |
| Qwen2.5-VL-7B-InstructFeatures=Passive2026.06 | 29.5 | |
| Qwen3-VL-8B-InstructCategory=Open-source General Models2026.05 | 29.4 | |
| Qwen2.5-VL-7B-InstructFeatures=Passive2026.06 | 29.26 | |
| Spatial-MLLMFeatures=Passive, 2D+3D2026.06 | 20.92 |