Video Spatial Reasoning on STI-Bench
41.4AccuracyGemini-2.5-pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-2.5-pro2025.10 | 41.4 | |
| Qwen2.5-VL-72BParameters=72B2025.10 | 40.7 | |
| GPT-52025.10 | 39.3 | |
| InternVL3.5-38BParameters=38B2025.10 | 39.2 | |
| SpaceVista-7BParameters=7B, RL=true2025.10 | 38.2 | |
| SpaceR-7BParameters=7B2025.10 | 37 | |
| SpaceVista-7BParameters=7B2025.10 | 35.9 | |
| Qwen2.5-VL-7BFine-tuned on=SpaceVista-1M2025.10 | 35 | |
| InternVL3.5-8BParameters=8B2025.10 | 33.2 | |
| Qwen2.5-VL-7BParameters=7B2025.10 | 32.1 | |
| VILASR-7BParameters=7B2025.10 | 31.5 | |
| SpatialMLLM-4BParameters=4B2025.10 | 30.5 | |
| LLaVA-NeXT-Video-7BParameters=7B2025.10 | 29.9 | |
| VG LLM-4BParameters=4B2025.10 | 29.3 | |
| LLAVA-Onevision-7BParameters=7B2025.10 | 29 |