Spatial Reasoning on SpaCE10
91.3ScoreHuman Level
Evaluation Results
| Method | Links | |
|---|---|---|
| Human LevelModel Category=Baseline2026.05 | 91.3 | |
| GPT-4oModel Category=Proprietary Models2026.05 | 58.3 | |
| Claude-3.7-SonnetModel Category=Proprietary Models2026.05 | 46 | |
| LLaVA-OneVision-7BModel Category=Open-Source General Models2026.05 | 45.2 | |
| InternVL3-2BModel Category=Open-Source General Models2026.05 | 44.2 | |
| SpatialForgeQwen3-VL-2BModel Category=Ours2026.05 | 38 | |
| Qwen2.5-VL-7BModel Category=Open-Source General Models2026.05 | 37.4 | |
| Qwen3-VL-2BModel Category=Open-Source General Models2026.05 | 35.6 | |
| Gemini-2.0-Flash-ThinkingModel Category=Proprietary Models2026.05 | 34.3 | |
| SpaceR-7BModel Category=Open-sourced Specialized Models2026.05 | 33.3 | |
| SpaceQwen2.5-VL-3B-InstructModel Category=Open-sourced Specialized Models2026.05 | 32 | |
| Qwen2.5-VL-3BModel Category=Open-Source General Models2026.05 | 31.7 | |
| SpatialLadder-3BModel Category=Open-sourced Specialized Models2026.05 | 27.1 | |
| SpaceMantis-8BModel Category=Open-sourced Specialized Models2026.05 | 26.3 | |
| RandomModel Category=Baseline2026.05 | 25 |