Spatial Reasoning on SpatialVQA (test)
62.7Average ScoreSpatialLLM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SpatialLLMCategory=Spatial-centric2025.05 | 62.7 | 86.3 | 52.9 | 50.8 | |
| GPT-4oCategory=Proprietary2025.05 | 54 | 59.4 | 52.4 | 50.8 | |
| SpatialVLM-13BCategory=Spatial-centric, Parameters=13B2025.05 | 52.2 | 64.3 | 48.5 | 45.8 | |
| Cambrian-8BCategory=Open-sourced, Parameters=8B2025.05 | 51.7 | 59.8 | 46.4 | 48.9 | |
| LLaVA-NeXT-8BCategory=Open-sourced, Parameters=8B2025.05 | 50.6 | 63.5 | 49.2 | 41.5 | |
| Claude 3.5 SonnetCategory=Proprietary2025.05 | 49.3 | 50.8 | 44.5 | 51.5 | |
| LLaVA-v1.5-7BCategory=Open-sourced, Parameters=7B2025.05 | 47.7 | 50.6 | 46.4 | 46.2 | |
| GPT-4o MiniCategory=Proprietary2025.05 | 45.4 | 46.9 | 39.3 | 48.5 |