Spatial Reasoning on 3DSRBench
95.7Overall AccuracyHuman
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HumanCategory=Reference2026.05 | 95.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SPATIOStrategy=Adaptive Role Orchestration2026.04 | 72.4 | 75.2 | 65.8 | 87.3 | 76.5 | 59.4 | 49.9 | 63.7 | 76.1 | 36.8 | 44.6 | 81.5 | 77.2 | |
| Gemini 3 ProCategory=Proprietary Models2026.05 | 68.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gpt-5.22026.04 | 67.2 | 68.6 | 68.7 | 81.3 | 74.3 | 51 | 74.3 | 63.4 | 82.6 | 38.5 | 49.3 | 78.2 | 59.6 | |
| SpatialMASStrategy=Adaptive Role Orchestration2026.04 | 67.1 | 73.8 | 64.2 | 84.9 | 74.9 | 58.7 | 48.6 | 62.5 | 74.3 | 35.9 | 43.5 | 79.6 | 75.3 | |
| Claude opus 4.62026.04 | 63.5 | 73.8 | 63.1 | 77.4 | 78.3 | 53 | 72.3 | 55.4 | 78.3 | 42.2 | 48.2 | 60.7 | 59 | |
| ProSRDescription=QWEN3-VL-8B-THINKING + Ours2026.05 | 62.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-3.2Category=Proprietary Models2026.05 | 60.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 2.5 ProCategory=Proprietary Models2026.05 | 59.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen-3.0-VL-4BLoRA training=Without2026.04 | 59.2 | 67.2 | 57.8 | 81.7 | 65.1 | 49.3 | 62.7 | 51.2 | 55.8 | 28.6 | 39.7 | 72.6 | 50.7 | |
| Qwen-3.0-VL-4BLoRA training=With2026.04 | 59.1 | 62.4 | 59.1 | 79.9 | 65.7 | 50.1 | 62.4 | 54.4 | 59.3 | 28.3 | 38.2 | 78.2 | 46.9 | |
| QWEN3-VL-8B-THINKING + GRPOMethod Variant=Vanilla GRPO2026.05 | 59.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| NashStrategy=Step-wise verification2026.05 | 59.02 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GeoWeaver-5BScale=5B2026.05 | 58.6 | — | — | — | — | — | — | — | — | — | — | — | — | |
| QWEN3-VL-8B-THINKING + SFTMethod Variant=SFT Only2026.05 | 57.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Seed 1.6Category=Proprietary Models2026.05 | 56.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaseStrategy=Step-wise verification2026.05 | 56.12 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-VL-8B-ThinkingCategory=Open-source General Models2026.05 | 55.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpatialReasonerLoRA training=With2026.04 | 54.3 | 69.4 | 54.3 | 71.5 | 50.3 | 53.3 | 51.7 | 45 | 49.4 | 30.2 | 33.6 | 68.5 | 54 | |
| Qwen3-VL-8B-InstructCategory=Open-source General Models2026.05 | 53.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SenseNova-SI-1.1-Qwen3-VL-8BCategory=Open-source Spatial Intelligence Models2026.05 | 53.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| VST-7B-SFTCategory=Open-source Spatial Intelligence Models2026.05 | 53.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LLaVA CriticStrategy=Step-wise verification2026.05 | 52.71 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpatialReasonerLoRA training=Without2026.04 | 52.4 | 69.4 | 51.3 | 73 | 57.1 | 49.3 | 50.3 | 47.4 | 51.2 | 29.4 | 31.8 | 69.4 | 48.3 | |
| GeoThinkerCategory=Open-source Spatial Intelligence Models2026.05 | 51.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| VLM-3R-7BScale=7B2026.05 | 51.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Sa2VALoRA training=Without2026.04 | 50.5 | 58.2 | 48.6 | 52.2 | 59.4 | 50.1 | 58.7 | 51.2 | 54.1 | 27.1 | 28.6 | 57.5 | 51.9 | |
| BAGEL-7B-MoTCategory=Open-source General Models2026.05 | 50.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Llava-4DLoRA training=With2026.04 | 49.7 | 59 | 57.5 | 57.7 | 50.9 | 49.9 | 35.6 | 50.3 | 52.3 | 26 | 27.1 | 54.3 | 51.3 | |
| InternVL3.5-8BCategory=Open-source General Models2026.05 | 49.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Llava-4DLoRA training=Without2026.04 | 49.1 | 51.9 | 48.7 | 58.1 | 58.9 | 50.1 | 44.2 | 50.6 | 56.1 | 20.4 | 24.8 | 57.5 | 56.3 | |
| Sa2VALoRA training=With2026.04 | 48.5 | 59.4 | 43.2 | 46.5 | 48 | 50.1 | 62.4 | 48 | 48.8 | 23.6 | 26.8 | 59.3 | 61.9 | |
| DatologyScale=4B2026.05 | 48 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VL-7B-InstructCategory=Open-source General Models2026.05 | 47.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-VLScale=2B2026.05 | 47 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ViLaSR-7BScale=7B2026.05 | 46.6 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-VLScale=4B2026.05 | 46.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DatologyScale=2B2026.05 | 45.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-VLScale=4B2026.05 | 45 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cambrian-S-7BScale=7B2026.05 | 45 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cambrian-S-7BCategory=Open-source Spatial Intelligence Models2026.05 | 45 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-VLScale=2B2026.05 | 43.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| InternVL3.5Scale=2B2026.05 | 43 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DatologyScale=1B2026.05 | 42.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpatialLadder-3BScale=3B2026.05 | 42.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpatialLadder-3BCategory=Open-source Spatial Intelligence Models2026.05 | 42.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpatialRGPTLoRA training=Without2026.04 | 42.7 | 37.4 | 42.3 | 49.5 | 34.5 | 44 | 56.6 | 44.4 | 55 | 24.5 | 27.1 | 51.2 | 45.6 | |
| MAmmoTH-VLScale=4B2026.05 | 42 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpaceR-7BScale=7B2026.05 | 40.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpaceR-SFT-7BCategory=Open-source Spatial Intelligence Models2026.05 | 40.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpatialRGPTLoRA training=With2026.04 | 39.8 | 29 | 37.9 | 54.3 | 24.5 | 46.9 | 48.5 | 50.3 | 48.5 | 17.5 | 30.2 | 44.3 | 45.2 | |
| InternVL3Scale=2B2026.05 | 38.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Spatial-MLLM-4BScale=4B2026.05 | 36.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| VisionSR1Strategy=Step-wise verification2026.05 | 35.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAmmoTH-VLScale=2B2026.05 | 32.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| InternVL3.5Scale=4B2026.05 | 32.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAmmoTH-VLScale=1B2026.05 | 32.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Random ChoiceCategory=Reference2026.05 | 20.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SherlockStrategy=Step-wise verification2026.05 | 11.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| MindCube-3BScale=3B2026.05 | 2.8 | — | — | — | — | — | — | — | — | — | — | — | — |