Visual Spatial Understanding on VSI-Bench static 1.0
89.5Average ScoreRieMind
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RieMindCategory=Ours (Agentic Framework), Backbone=GPT-4.12026.03 | 89.5 | 86.5 | 94.9 | 97.9 | 77.8 | 92.7 | 87.3 | |
| RieMindCategory=Ours (Agentic Framework), Backbone=GPT-4o2026.03 | 85.2 | 85.1 | 93.2 | 96.5 | 83.5 | 85.6 | 67.5 | |
| SpaceMindCategory=Fine-tuned2026.03 | 73.6 | 73.3 | 61.4 | 77.3 | 74.2 | 67.2 | 88.4 | |
| VLM-3RCategory=Fine-tuned2026.03 | 67 | 70.2 | 49.4 | 69.2 | 67.1 | 65.4 | 80.5 | |
| RieMindCategory=Ours (Agentic Framework), Backbone=Qwen2.5-VL-7B2026.03 | 64.1 | 89.7 | 90.3 | 93.6 | 31.9 | 44.5 | 34.7 | |
| ViCACategory=Fine-tuned2026.03 | 63.5 | 68.8 | 57 | 79.2 | 75.1 | 58.5 | 42.6 | |
| VG-LLMCategory=Fine-tuned2026.03 | 52.3 | 67.9 | 37.7 | 58.6 | 62 | 46.6 | 40.7 | |
| InternVL3-78BCategory=Open-Source2026.03 | 50.7 | 71.2 | 53.7 | 44.4 | 39.5 | 55.9 | 39.5 | |
| Spatial-MLLMCategory=Fine-tuned2026.03 | 49.3 | 65.3 | 34.8 | 63.1 | 45.1 | 41.3 | 46.2 | |
| Gemini-1.5 ProCategory=Proprietary2026.03 | 48.7 | 56.2 | 30.9 | 64.1 | 43.6 | 51.3 | 46.3 | |
| OCRCategory=Fine-tuned2026.03 | 47.8 | 63.2 | 34.1 | 57.4 | 46.7 | 39.6 | 45.5 | |
| ViLaSRCategory=Fine-tuned2026.03 | 47.3 | 63.5 | 34.4 | 60.6 | 30.9 | 48.9 | 45.2 | |
| SpaceRCategory=Fine-tuned2026.03 | 46.4 | 57.8 | 28.2 | 59.9 | 47.1 | 40.1 | 45.4 | |
| Gemini-1.5 FlashCategory=Proprietary2026.03 | 44.5 | 49.8 | 30.8 | 53.5 | 54.4 | 37.7 | 41 | |
| LLaVA-OneVision-72BCategory=Open-Source2026.03 | 40.8 | 43.5 | 23.9 | 57.6 | 37.5 | 42.5 | 39.9 | |
| LLaVA-NeXT-Video-72BCategory=Open-Source2026.03 | 40.6 | 48.9 | 22.8 | 57.4 | 35.3 | 42.4 | 36.7 | |
| LLaVA-NeXT-Video-7BCategory=Open-Source2026.03 | 36.7 | 48.5 | 14 | 47.8 | 24.2 | 43.5 | 42.4 | |
| GPT-4oCategory=Proprietary2026.03 | 35.3 | 46.2 | 5.3 | 43.8 | 38.2 | 37 | 41.3 | |
| LLaVA-OneVision-7BCategory=Open-Source2026.03 | 34.2 | 47.7 | 20.2 | 47.4 | 12.3 | 42.5 | 35.2 | |
| Qwen2.5-VL-7BCategory=Open-Source2026.03 | 31.2 | 40.9 | 14.8 | 43.4 | 10.7 | 38.6 | 38.5 |