Spatial Reasoning on VSI-Bench (test)
79.2Avg ScoreHuman level
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Human level2026.05 | 79.2 | 94.3 | 47 | 60.4 | 45.9 | 94.7 | 95.8 | 95.8 | 100 | — | |
| 3D-RFT-4BTraining Stage=Reinforcement Fine-Tuned2026.03 | 62.8 | 71.2 | 53.5 | 70.3 | 63.2 | 60.8 | 77.9 | 37.6 | 67.8 | — | |
| VLM-3R-7BTraining Stage=Supervised Fine-Tuned2026.03 | 60.9 | 70.2 | 49.4 | 69.2 | 67.1 | 65.4 | 80.5 | 45.4 | 40.1 | — | |
| VST-SFT-3BTraining Stage=Supervised Fine-Tuned2026.03 | 57.9 | 69.3 | 45.4 | 71.8 | 62.4 | 59 | 46 | 38.7 | 70.2 | — | |
| VST-RL-3BTraining Stage=Reinforcement Fine-Tuned2026.03 | 57.7 | 66.6 | 45 | 72.8 | 60.9 | 59.9 | 47.6 | 40.7 | 68.3 | — | |
| Cambrian-S-3BTraining Stage=Supervised Fine-Tuned2026.03 | 57.3 | 70.7 | 40.6 | 68 | 46.3 | 64.8 | 61.9 | 27.3 | 78.8 | — | |
| Gemini-2.5 ProTraining Stage=Zero-shot2026.03 | 51.5 | 43.8 | 34.9 | 64.3 | 42.8 | 61.1 | 47.8 | 45.9 | 71.3 | — | |
| Spatial-MLLM-4BTraining Stage=Reinforcement Fine-Tuned2026.03 | 48.4 | 65.3 | 34.8 | 63.1 | 45.1 | 41.3 | 46.2 | 33.5 | 46.3 | — | |
| Spatial-MLLM-4BAccess Type=Open-source, Input Frames=16-322026.05 | 48.4 | 65.3 | 34.8 | 63.1 | 45.1 | 41.3 | 46.2 | 33.5 | 46.3 | 1 | |
| VG LLM-4BTraining Stage=Supervised Fine-Tuned2026.03 | 47.3 | 66 | 37.8 | 55.2 | 59.2 | 44.6 | 45.6 | 33.5 | 36.4 | — | |
| Proxy3DAccess Type=Open-source, Backbone=Qwen2.5-VL-7B, Input Frames=162026.05 | 47 | 63.9 | 41.9 | 67.2 | 42.8 | 50.3 | 46.5 | 31.4 | 32 | 2 | |
| SpatialLadder-3BTraining Stage=Reinforcement Fine-Tuned2026.03 | 45.7 | 63.5 | 34.3 | 61.7 | 43.9 | 45.4 | 44.8 | 35.6 | 36.4 | — | |
| ViLaSR-7BTraining Stage=Reinforcement Fine-Tuned2026.03 | 45.4 | 63.5 | 34.4 | 60.6 | 30.9 | 48.9 | 45.2 | 30.4 | 49.2 | — | |
| Gemini-1.5 ProAccess Type=Proprietary via API, Input Frames=16-322026.05 | 45.4 | 56.2 | 30.9 | 64.1 | 43.6 | 51.3 | 46.3 | 36 | 34.6 | 3 | |
| PyVision-VideoBackbone=Qwen2.5-VL-7B, Training=RL, Tooling=dynamic tooling2026.02 | 44 | 53.8 | 25.8 | 50.8 | 38.2 | 44.8 | 46.3 | 26.3 | 58.6 | — | |
| SpaceR-7BTraining Stage=Reinforcement Fine-Tuned2026.03 | 43.5 | 61.9 | 28.6 | 60.9 | 35.2 | 38.2 | 46 | 31.4 | 45.6 | — | |
| InternVL3-8BTraining Stage=Zero-shot2026.03 | 42.1 | 68.1 | 39 | 48.4 | 33.6 | 48.3 | 36.4 | 27.3 | 35.4 | — | |
| VITALAgent Type=agentic video model, Tools=predefined video clipping tools, Backbone=Qwen2.5-VL-7B, Training=RL2026.02 | 41.8 | — | — | — | — | — | — | — | — | — | |
| LLaVA-Video-72BAccess Type=Open-source, Input Frames=16-322026.05 | 40.9 | 48.9 | 22.8 | 57.4 | 35.3 | 42.4 | 36.7 | 35 | 48.6 | 4 | |
| vsGRPO-7BTraining Stage=Reinforcement Fine-Tuned2026.03 | 40.7 | 59.9 | 29.6 | 50.8 | 48.3 | 35.4 | 35.6 | 34 | 31.5 | — | |
| LLaVA-OV-72BAccess Type=Open-source, Input Frames=16-322026.05 | 40.2 | 43.5 | 23.9 | 57.6 | 37.5 | 42.5 | 39.9 | 32.5 | 44.6 | 5 | |
| Video-R1Reasoning Type=pure textual reasoning, Backbone=Qwen2.5-VL-7B, Training=RL2026.02 | 37.1 | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VL-72BAccess Type=Open-source, Input Frames=162026.05 | 37 | 25.1 | 29.3 | 54.5 | 38.8 | 38.2 | 37 | 34 | 28.9 | 6 | |
| Qwen2.5-VL-7BBackbone=Qwen2.5-VL-7B2026.02 | 36.7 | 41.9 | 21.4 | 50.4 | 36.8 | 38.5 | 40.9 | 29.9 | 34.1 | — | |
| InternVL2-40BAccess Type=Open-source, Input Frames=16-322026.05 | 36 | 34.9 | 26.9 | 46.5 | 31.8 | 42.1 | 32.2 | 34 | 39.6 | 7 | |
| LLaVA-Video-7BTraining Stage=Zero-shot2026.03 | 35.6 | 48.5 | 14 | 47.8 | 24.2 | 43.5 | 42.4 | 34 | 30.6 | — | |
| vsGRPO-2BTraining Stage=Reinforcement Fine-Tuned2026.03 | 35.4 | 53.6 | 29 | 52.7 | 43.4 | 28.1 | 30.9 | 26.8 | 18.9 | — | |
| GPT-4oTraining Stage=Zero-shot2026.03 | 34 | 46.2 | 5.3 | 43.8 | 38.2 | 37 | 41.3 | 31.5 | 28.5 | — | |
| GPT-4oAccess Type=Proprietary via API, Input Frames=16-322026.05 | 34 | 46.2 | 5.3 | 43.8 | 38.2 | 37 | 41.3 | 31.5 | 28.5 | 8 | |
| Qwen2.5-VL-7BAccess Type=Open-source, Input Frames=162026.05 | 33 | 40.9 | 14.8 | 43.4 | 10.7 | 38.6 | 38.5 | 33 | 29.8 | 9 | |
| Qwen2.5-VL-7BTraining Stage=Zero-shot2026.03 | 32.7 | 34.5 | 19.4 | 47.6 | 40.8 | 32.8 | 24.5 | 32.5 | 29.4 | — |