Multi-view spatial reasoning on MINDCUBE Tiny
94.1Overall AccuracyGAMSI_S1+S2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GAMSI_S1+S2SI Dataset=950K2026.05 | 94.1 | — | — | — | |
| GAMSI_S1SI Dataset=800K2026.05 | 75.1 | — | — | — | |
| SenseNova-SI-Qwen3-VL-8BSI Dataset=8M2026.05 | 73.8 | — | — | — | |
| OmniView-Space-R1†Mode=Tool-Integrated2026.07 | 71.5 | 53 | 79.2 | 68 | |
| Ours 4B (Grounded-CoT)Tuning on MINDCUBE=w/o Tuning2026.03 | 70 | 71.5 | 66.33 | 74.75 | |
| SenseNova-SI-InternVL3-8BSI Dataset=66.72026.05 | 66.7 | — | — | — | |
| DR-MV3D (Qwen2.5-VL-Instruct w/ SFT + GRPO)Params=3B, Anno.=✓2026.06 | 66.5 | 43 | 71.3 | 73.6 | |
| OmniView-Space-R1‡Mode=Tool-Distillation2026.07 | 65.7 | 48.5 | 69.2 | 71.2 | |
| DR-MV3D (Qwen2.5-VL-Instruct w/ SFT)Params=3B, Anno.=✓2026.06 | 62.4 | 42 | 66.3 | 69.2 | |
| MINDCUBE-PlainTuning on MINDCUBE=w Tuning2026.03 | 60.76 | 47.5 | 62.33 | 67.6 | |
| Ours 2B (Grounded-CoT)Tuning on MINDCUBE=w/o Tuning2026.03 | 59.92 | 49 | 56.5 | 70.5 | |
| Gemini-2.5-ProParams=-, Anno.=✗2026.06 | 59.3 | 85 | 49.2 | 58.3 | |
| GPT-5.2Model Type=Proprietary2026.07 | 58.4 | 95.5 | 41.5 | 69.2 | |
| DR-MV3D (Qwen2.5-VL-Instruct w/ SFT + GRPO) w/o Anno.Params=3B, Anno.=✗2026.06 | 57.7 | 36.5 | 60.7 | 67.6 | |
| GPT-5Params=-, Anno.=✗2026.06 | 56.3 | 94.5 | 38.2 | 68.4 | |
| MINDCUBE-AugTuning on MINDCUBE=w Tuning2026.03 | 55.24 | 49.5 | 52.5 | 66.4 | |
| MindCube-CGMap-SFT(Qwen2.5-VL-Instruct)Params=3B, Anno.=✓2026.06 | 54.4 | 34.5 | 54.2 | 70.8 | |
| MindCube-CGMap-FFR-RL(Qwen2.5-VL-Instruct)Params=3B, Anno.=✓2026.06 | 53.7 | 33 | 53.7 | 70.4 | |
| DR-MV3D (Qwen2.5-VL-Instruct w/ SFT) w/o Anno.Params=3B, Anno.=✗2026.06 | 53.6 | 36.5 | 52.2 | 64 | |
| MindCube-RawQA-SFT(Qwen2.5-VL-Instruct)Params=3B, Anno.=✓2026.06 | 51.7 | 34 | 51 | 67.6 | |
| MindCube-3BModel Type=Spatial Intelligence2026.07 | 51.7 | 34 | 51 | 67.6 | |
| OmniView-Space-SFTMode=Tool-Distillation2026.07 | 50.9 | 47 | 49.8 | 55.8 | |
| SenseNova-SI(Bagel-MoT)Params=7B, Anno.=✗2026.06 | 50.8 | 37.5 | 57.1 | 46.8 | |
| GPT-4.1Model Type=Proprietary2026.07 | 50.6 | 49.5 | 47.2 | 59.6 | |
| MindCube-CGMap-FFR-SFT(Qwen2.5-VL-Instruct)Params=3B, Anno.=✓2026.06 | 50.1 | 31.5 | 49.8 | 65.6 | |
| GPT-4.1Params=-, Anno.=✗2026.06 | 49.6 | 60 | 46.7 | 55 | |
| OmniView-Space-ZeroMode=Tool-Integrated2026.07 | 49.1 | 32.5 | 52.8 | 53.6 | |
| Gemini-3-ProModel Type=Proprietary2026.07 | 49 | 54.5 | 46 | 51.6 | |
| DeepSeek-VL2-SmallTuning on MINDCUBE=w/o Tuning2026.03 | 47.62 | 37 | 50.38 | 26.91 | |
| Gemma-3-12B-itTuning on MINDCUBE=w/o Tuning2026.03 | 46.67 | 38.39 | 48.38 | 34.63 | |
| GPT-5-miniTuning on MINDCUBE=w/o Tuning2026.03 | 46.64 | 89 | 44.67 | 51.75 | |
| Claude-4-SonnetTuning on MINDCUBE=w/o Tuning2026.03 | 44.75 | 48.42 | 44.21 | 47.62 | |
| SpatialLadder-3BSI Dataset=260K2026.05 | 43.5 | — | — | — | |
| SpatialLadder-3BModel Type=Spatial Intelligence2026.07 | 43.4 | 35 | 43.2 | 50.8 | |
| Spatial-MLLMParams=4B, Anno.=✗2026.06 | 42.8 | 32.5 | 47.5 | 35 | |
| Qwen2.5-VL-3B-Instruct2026.05 | 42.5 | — | — | — | |
| InternVL3-8B2026.05 | 41.8 | — | — | — | |
| Think3D(Qwen3-VL-RL)Params=4B, Anno.=✗2026.06 | 41.7 | 41.7 | 35 | 39.2 | |
| InternVL3 (8B)Params=8B, Anno.=✗2026.06 | 41.5 | 36.5 | 38.1 | 53.6 | |
| InternVL3-8BModel Type=Open-source General2026.07 | 41.5 | 36.5 | 38.1 | 53.6 | |
| SenseNova-SI(InternVL3)Params=2B, Anno.=✗2026.06 | 41.2 | 33.5 | 44.4 | 40 | |
| Mantis-8B (SigLip)Tuning on MINDCUBE=w/o Tuning2026.03 | 41.05 | 37.65 | 40.23 | 50.99 | |
| OpenviewTuning on MINDCUBE=w/o Tuning2026.03 | 40.08 | 24.5 | 45.5 | 39.75 | |
| Cambrian-S-7BModel Type=Spatial Intelligence2026.07 | 39.7 | 37 | 35.9 | 50.8 | |
| VST-7B-SFTSI Dataset=4M2026.05 | 39.1 | — | — | — | |
| Cambrian-S-3BSI Dataset=590K2026.05 | 39 | — | — | — | |
| GPT-4oTuning on MINDCUBE=w/o Tuning2026.03 | 38.81 | 32.65 | 40.17 | 29.16 | |
| GPT-5-nanoTuning on MINDCUBE=w/o Tuning2026.03 | 38.58 | 44 | 38.67 | 35.75 | |
| Qwen3-VL-8B-InstructModel Type=Open-source General2026.07 | 38.4 | 36 | 32.8 | 53.6 | |
| Cambrian-S-7BSI Dataset=590K2026.05 | 38.1 | — | — | — | |
| SpaceR-7BModel Type=Spatial Intelligence2026.07 | 37.9 | 35 | 34.2 | 49.2 | |
| Qwen2.5-VL-Instruct (3B)Params=3B, Anno.=✗2026.06 | 37.8 | 34 | 36 | 45.2 | |
| Qwen3-VL-ThinkingParams=4B, Anno.=✗2026.06 | 37.5 | 55 | 28.7 | 44.8 | |
| InternVL3 (2B)Params=2B, Anno.=✗2026.06 | 37.5 | 28.9 | 36.9 | 45.6 | |
| Qwen3-VL-8BTuning on MINDCUBE=w/o Tuning2026.03 | 37.42 | 46 | 35.83 | 35.5 | |
| RoBobrainTuning on MINDCUBE=w/o Tuning2026.03 | 37.38 | 35.8 | 38.28 | 29.53 | |
| Molmo2-4BTuning on MINDCUBE=w/o Tuning2026.03 | 37.33 | 36 | 38.83 | 35.75 | |
| InternVL3-2B2026.05 | 36.8 | — | — | — | |
| Qwen3-VL-4BTuning on MINDCUBE=w/o Tuning2026.03 | 36.67 | 41.5 | 34.67 | 37.25 | |
| VST-3B-SFTSI Dataset=4M2026.05 | 36 | — | — | — | |
| Qwen3-VL-4B-InstructModel Type=Open-source General2026.07 | 35.9 | 34.1 | 20 | 41.6 | |
| Idefics2-8BTuning on MINDCUBE=w/o Tuning2026.03 | 35.86 | 35.15 | 35.94 | 35.49 | |
| Qwen3-VL-2B-Instruct2026.05 | 35.7 | — | — | — | |
| ViLaSR-7BSI Dataset=81K2026.05 | 35.2 | — | — | — | |
| ViLaSR-7BModel Type=Spatial Intelligence2026.07 | 35 | 35.5 | 31 | 44.4 | |
| Random (chance)Params=-, Anno.=✗2026.06 | 34.9 | 38 | 37 | 32.8 | |
| Bagel-MoTParams=7B, Anno.=✗2026.06 | 34.7 | 34.5 | 31.3 | 42.8 | |
| Molmo2-8BTuning on MINDCUBE=w/o Tuning2026.03 | 34.33 | 27.5 | 36.5 | 34.5 | |
| Bagel-7B-MoT2026.05 | 34.2 | — | — | — | |
| Qwen2.5-VL-7B-Instruct2026.05 | 34.2 | — | — | — | |
| Qwen2.5-VL-Instruct (7B)Params=7B, Anno.=✗2026.06 | 34 | 37.5 | 31.2 | 38 | |
| Spatial-MLLM-4BSI Dataset=135K2026.05 | 33.5 | — | — | — | |
| Spatial-MLLM-4BModel Type=Spatial Intelligence2026.07 | 33.4 | 39 | 30.5 | 36 | |
| Random (frequency)Tuning on MINDCUBE=-2026.03 | 33.02 | 38.3 | 32.66 | 35.79 | |
| Random (frequency)Params=-, Anno.=✗2026.06 | 33 | 35.7 | 33.3 | 31.8 | |
| Qwen3-VL-2BTuning on MINDCUBE=w/o Tuning2026.03 | 32.58 | 26.5 | 36.33 | 30 | |
| Random (chance)Tuning on MINDCUBE=-2026.03 | 32.35 | 36.36 | 32.29 | 30.66 | |
| SpaceR-7BSI Dataset=151K2026.05 | 32.1 | — | — | — | |
| Spatial-MLLMTuning on MINDCUBE=w/o Tuning2026.03 | 32.06 | 38.39 | 20.92 | 32.82 | |
| Qwen3-VL-InstructParams=4B, Anno.=✗2026.06 | 31.1 | 26 | 26.7 | 46 | |
| Qwen3-VL-8B-Instruct2026.05 | 29.9 | — | — | — | |
| Qwen2.5-VL-7B-InstructModel Type=Open-source General2026.07 | 29.3 | 38.8 | 29.5 | 21.4 | |
| Qwen2.5-VL-7BTuning on MINDCUBE=w/o Tuning2026.03 | 29.26 | 38.76 | 29.5 | 21.35 | |
| Internvl2.5-8BTuning on MINDCUBE=w/o Tuning2026.03 | 18.68 | 36.45 | 47.11 | 26.91 |