Spatial Understanding on BLINK (val)
90.9Spatial RelationGPT-5-0807
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5-0807Model Type=Proprietary2025.11 | 90.9 | 81.4 | 86.1 | |
| SpatialThinker-30B (Ours)Model Scale=30B2025.11 | 88.1 | 79.8 | 84 | |
| Qwen3-VL-30BModel Scale=30B2025.11 | 86 | 75.8 | 80.9 | |
| SpatialThinker-7B (Ours)Model Scale=7B2025.11 | 86 | 72.6 | 79.3 | |
| Qwen2.5-VL-7BModel Scale=7B2025.11 | 84 | 52.4 | 68.2 | |
| GPT-4o-0513Model Type=Proprietary2025.11 | 82.5 | 78.2 | 80.4 | |
| SpatialThinker-3B (Ours)Model Scale=3B2025.11 | 81.8 | 66.9 | 74.4 | |
| VLAA-Thinker-Qwen2.5-VL-7BBackbone=Qwen2.5-VL-7B2025.11 | 81.2 | 71 | 76.1 | |
| SpaceOm2025.11 | 81.1 | 65.3 | 73.2 | |
| Qwen2.5-VL-7B + Vanilla GRPOModel Scale=7B, Training Protocol=Vanilla GRPO2025.11 | 80.4 | 75 | 77.7 | |
| Claude-4-Sonnet-0514Model Type=Proprietary2025.11 | 79 | 78.2 | 78.6 | |
| SATORI-R12025.11 | 77 | 58.9 | 68 | |
| Qwen2.5-VL-7B + SFTModel Scale=7B, Training Protocol=SFT2025.11 | 75.5 | 64.5 | 70 | |
| SpaceThinker2025.11 | 73.4 | 59.9 | 66.7 | |
| Qwen2.5-VL-3B + Vanilla GRPOModel Scale=3B, Training Protocol=Vanilla GRPO2025.11 | 73.4 | 55.6 | 64.5 | |
| SpaceLLaVA-13BModel Scale=13B2025.11 | 72.7 | 62.9 | 67.8 | |
| Cambrian-1-8BModel Scale=8B2025.11 | 69.9 | 73.4 | 71.7 | |
| SpatialBot-3BModel Scale=3B2025.11 | 67.8 | 67.7 | 67.8 | |
| Qwen2.5-VL-3BModel Scale=3B2025.11 | 66.4 | 54 | 60.2 | |
| Spatial-RGPT-7B w/ depthModel Scale=7B, Auxiliary Inputs=depth2025.11 | 65.7 | 72.3 | 69 | |
| Qwen2.5-VL-3B + SFTModel Scale=3B, Training Protocol=SFT2025.11 | 65 | 66.9 | 66 | |
| RoboPoint-13BModel Scale=13B2025.11 | 60.8 | 61.3 | 61.1 | |
| Claude-3.5-Sonnet-0620Model Type=Proprietary2025.11 | 58.7 | 67.7 | 63.2 |