Multimodal Spatial Reasoning on Our-Bench SpatialTree-Bench 1.0 (test)
57.8Average ScoreGemini3-Flash
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemini3-FlashThinking Category=Thinking Models, Model Category=Proprietary, Rank=12025.12 | 57.8 | 50.1 | 40.7 | 62.9 | 62.4 | 54.6 | 62 | 66.8 | 58.4 | 68.6 | 31.6 | 70.8 | |
| Gemini3-ProThinking Category=Thinking Models, Model Category=Proprietary, Rank=22025.12 | 56.5 | 54.5 | 47.4 | 62.5 | 74 | 53.9 | 60.5 | 50.3 | 56 | 68.2 | 29.9 | 68.5 | |
| Seed1.8Thinking Category=Thinking Models, Model Category=Proprietary, Rank=32025.12 | 50.3 | 42.5 | 42.7 | 49.9 | 54.5 | 52.4 | 56.3 | 51 | 49.7 | 53.6 | 26 | 70.6 | |
| Gemini2.5-ProThinking Category=Thinking Models, Thinking Mode=Thinking, Model Category=Proprietary, Rank=42025.12 | 50.1 | 47.8 | 32.6 | 44.4 | 61.6 | 47.9 | 50.5 | 61.5 | 47.6 | 58.2 | 28.3 | 63.3 | |
| Gemini2.5 ProThinking Category=Non-Thinking, Thinking Mode=Non-Thinking (NT), Model Category=Proprietary, Rank=52025.12 | 41.4 | 36.2 | 30 | 33.2 | 47 | 48.5 | 43.3 | 55.2 | 39.6 | 47.5 | 29.2 | 46 | |
| Seed1.5vlThinking Category=Thinking Models, Model Category=Proprietary, Rank=62025.12 | 41.3 | 39.2 | 36.6 | 24.6 | 44.7 | 44.8 | 46.5 | 38.5 | 36.6 | 47 | 28.4 | 25.9 | |
| Gemini2.5-FlashThinking Category=Thinking Models, Thinking Mode=Thinking, Model Category=Proprietary, Rank=72025.12 | 41.1 | 35.6 | 29.3 | 40.5 | 56.2 | 44.6 | 43.1 | 51.4 | 36.4 | 49.1 | 26.9 | 46.6 | |
| Qwen3VL-235BThinking Category=Open-source Models, Rank=82025.12 | 40 | 33.9 | 27.4 | 35.1 | 35.4 | 38.9 | 43.7 | 53.4 | 37.3 | 44.7 | 28.8 | 48.9 | |
| GLM4.5VThinking Category=Thinking Models, Model Category=Proprietary, Rank=92025.12 | 36 | 35.3 | 24 | 32.5 | 34.5 | 43.7 | 34.5 | 34.1 | 33.8 | 41 | 26.8 | 49.7 | |
| Gemini2.5 FlashThinking Category=Non-Thinking, Thinking Mode=Non-Thinking (NT), Model Category=Proprietary, Rank=102025.12 | 35.8 | 31.6 | 29.3 | 30.8 | 35.2 | 45.4 | 36.4 | 53.7 | 28.4 | 36.9 | 27.6 | 45.7 | |
| Qwen3VL-30BThinking Category=Open-source Models, Rank=112025.12 | 35.3 | 31.9 | 26 | 32.3 | 20.7 | 39.2 | 37.8 | 48.1 | 32.7 | 44.2 | 25.8 | 40.9 | |
| Qwen2.5VL-72BThinking Category=Open-source Models, Rank=122025.12 | 33 | 24.4 | 22 | 28.6 | 37.5 | 37.3 | 38.9 | 35.1 | 32.6 | 38.4 | 23.9 | 38.6 | |
| GPT-4oThinking Category=Non-Thinking, Model Category=Proprietary, Rank=132025.12 | 31.9 | 23.9 | 38.6 | 29.8 | 24.2 | 36.2 | 31.2 | 43.6 | 29.3 | 40.5 | 25.8 | 39.2 | |
| Qwen2.5VL-32BThinking Category=Open-source Models, Rank=142025.12 | 27.9 | 21.4 | 30 | 25.8 | 22 | 35.1 | 29 | 21.7 | 32.8 | 37 | 14.1 | 38.6 | |
| Qwen2.5VL-7BThinking Category=Open-source Models, Rank=152025.12 | 27.5 | 17.8 | 22.6 | 23.9 | 20.6 | 31.6 | 34.7 | 15.2 | 28.4 | 39.8 | 24.5 | 31.1 | |
| Kimi-VL-A3BThinking Category=Open-source Models, Rank=162025.12 | 24.4 | 13.8 | 23.3 | 31.6 | 27 | 21.4 | 24.9 | 28.3 | 26.9 | 27.8 | 15.7 | 32.6 |