Video Spatial Intelligence on VSI-Bench 123 (test)
70Object CountMetric Anything
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Metric AnythingModel source=Open-source Models, Input frames=16 frames, Base VLM=LLaVA-Next-Video-7B2026.01 | 70 | 51.5 | 67.5 | 65 | 66.2 | 76.8 | 40.2 | 29 | 58.3 | 1 | |
| Spatial-MLLM-4BModel source=Open-source Models, Input frames=16 frames2026.01 | 65.3 | 34.8 | 63.1 | 45.1 | 41.3 | 46.2 | 33.5 | 46.3 | 48.4 | 2 | |
| Gemini-1.5 ProModel source=Proprietary Models, Input frames=1 FPS2026.01 | 56.2 | 30.9 | 64.1 | 43.6 | 51.3 | 46.3 | 36 | 34.6 | 45.4 | 3 | |
| LLaVA-Video-72BModel source=Open-source Models, Input frames=8 to 32 frames2026.01 | 48.9 | 22.8 | 57.4 | 35.3 | 42.4 | 36.7 | 35 | 48.6 | 40.9 | 4 | |
| GPT-4oModel source=Proprietary Models, Input frames=8 to 32 frames2026.01 | 46.2 | 5.3 | 43.8 | 38.2 | 37 | 41.3 | 31.5 | 28.5 | 34 | 8 | |
| LLaVA-OneVision-72BModel source=Open-source Models, Input frames=8 to 32 frames2026.01 | 43.5 | 23.9 | 57.6 | 37.5 | 42.5 | 39.9 | 32.5 | 44.6 | 40.2 | 5 | |
| Qwen2.5VL-7BModel source=Open-source Models, Input frames=16 frames2026.01 | 40.9 | 14.8 | 43.4 | 10.7 | 38.6 | 38.5 | 33 | 29.8 | 33 | 9 | |
| LongVA-7BModel source=Open-source Models, Input frames=8 to 32 frames2026.01 | 38 | 16.6 | 38.9 | 22.2 | 33.1 | 43.3 | 25.4 | 15.7 | 29.2 | 12 | |
| InternVL2-40BModel source=Open-source Models, Input frames=8 to 32 frames2026.01 | 34.9 | 26.9 | 46.5 | 31.8 | 42.1 | 32.2 | 34 | 39.6 | 36 | 7 | |
| LongVILA-8BModel source=Open-source Models, Input frames=8 to 32 frames2026.01 | 29.1 | 9.1 | 16.7 | 0 | 29.6 | 30.7 | 32.5 | 25.5 | 21.6 | 13 | |
| Qwen2.5VL-72BModel source=Open-source Models, Input frames=16 frames2026.01 | 25.1 | 29.3 | 54.5 | 38.8 | 38.2 | 37 | 34 | 28.9 | 37 | 6 | |
| Qwen2.5VL-3BModel source=Open-source Models, Input frames=16 frames2026.01 | 24.3 | 24.7 | 31.7 | 22.6 | 38.3 | 41.6 | 26.3 | 21.2 | 30.6 | 11 | |
| VILA-1.5-40BModel source=Open-source Models, Input frames=8 to 32 frames2026.01 | 22.4 | 24.8 | 48.7 | 22.7 | 40.5 | 25.7 | 31.5 | 32.9 | 31.2 | 10 |