Spatial Reasoning (Multi-Image) on ERQA
51.02AccuracyGemini2.5-Pro
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini2.5-ProParams=–2025.11 | 51.02 | |
| MiMo-EmbodiedParams=7B2025.11 | 46.75 | |
| Claude-Sonnet-4Params=–2025.11 | 45.75 | |
| ViLAVT-7BThinking Level=Chatting with Images2026.02 | 42.2 | |
| MiMo-VLParams=7B2025.11 | 41.5 | |
| VILASR-7BThinking Level=Thinking with Images2026.02 | 41 | |
| InternVL3.5Params=8B2025.11 | 41 | |
| Qwen-VL-MaxParams=–2025.11 | 40.91 | |
| SpaceR-7BThinking Level=Thinking about Images2026.02 | 40.3 | |
| Qwen2.5-VL-7BThinking Level=Thinking about Images2026.02 | 39.8 | |
| Qwen2.5-VL-7BThinking Level=Non-Thinking2026.02 | 39.3 | |
| Cosmos-Reason1Params=7B2025.11 | 39.09 | |
| Qwen2.5-VLParams=7B2025.11 | 38.8 | |
| Spatial-MLLM-4BThinking Level=Thinking about Images2026.02 | 38.3 | |
| VeBrainParams=8B2025.11 | 37.29 | |
| RoboBrain-1.0Params=7B2025.11 | 36.52 | |
| InternVL3-8BThinking Level=Non-Thinking2026.02 | 35.3 | |
| GPT-4oParams=–2025.11 | 32.48 | |
| LLaVA-OneVision-7BThinking Level=Non-Thinking2026.02 | 30.6 | |
| RoboBrain-2.0Params=7B2025.11 | 30.31 | |
| MagmaParams=8B2025.11 | 25.73 | |
| Multi-SpatialMLLMModel=Multi-SpatialMLLM2025.05 | 21.6 | |
| InternVL-8BModel=InternVL-8B2025.05 | 13.5 |