Spatial Reasoning on SpatialScore 1.0 (test)
86.6Overall ScoreHuman-level
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Human-levelModel Category=Baselines2025.05 | 86.6 | 96.87 | 89.72 | 82.33 | 92.15 | 85.18 | 81.64 | 78.96 | 94.46 | 86.89 | 84.19 | |
| Gemini-3-ProModel Scale=Proprietary, Rank=12025.05 | 60.12 | 70.4 | 62.99 | 58.15 | 62.44 | 60.02 | 64.2 | 49.5 | 71.12 | 51.37 | 59.93 | |
| GPT-5Model Scale=Proprietary, Rank=22025.05 | 58.13 | 78.08 | 57.59 | 55.13 | 54.04 | 59.22 | 67.39 | 45.01 | 57.11 | 50.9 | 62.13 | |
| Qwen3-VL-235B-A22BModel Scale=30B-78B, Rank=12025.05 | 56.63 | 57.27 | 65.19 | 54.04 | 52.47 | 59.9 | 70.01 | 50.4 | 69.4 | 42.8 | 49.63 | |
| VST-7B-RLModel Scale=7B-14B, Rank=12025.05 | 52.47 | 41.39 | 54.92 | 56.8 | 50 | 55.48 | 64.56 | 48.65 | 63.37 | 42.8 | 45.59 | |
| VST-3B-RLModel Scale=1B-4B, Rank=12025.05 | 48.04 | 24.61 | 52.38 | 51.75 | 43.72 | 54.16 | 61.84 | 43.03 | 62.89 | 38.95 | 47.43 | |
| VST-3B-SFTModel Scale=1B-4B, Rank=22025.05 | 47.37 | 25.73 | 48.45 | 53.11 | 45.74 | 53.02 | 61.41 | 42.35 | 60.48 | 35.35 | 50.74 | |
| Spatial-MLLM-4BModel Scale=1B-4B, Rank=32025.05 | 42.59 | 33.56 | 47.61 | 34.8 | 43.27 | 56.16 | 57.68 | 40.49 | 36.39 | 28.41 | 53.31 | |
| Blind GPT-5 (Text-only)Model Category=Baselines2025.05 | 30.62 | 18.79 | 20.34 | 29.36 | 40.81 | 31.05 | 45.34 | 24.2 | 25.54 | 32.01 | 26.47 | |
| Chance-level (Random)Model Category=Baselines2025.05 | 28.29 | 23.71 | 22.8 | 22.88 | 31.84 | 30.29 | 38.59 | 24.06 | 25.06 | 28.79 | 28.68 |