Spatial perception and reasoning on VSI-Bench (offline)
65.9Average ScoreStream3D-VLM-8B
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Stream3D-VLM-8BOnline=true2026.06 | 65.9 | 72.4 | 50.1 | 71.5 | 68.7 | 70.8 | 73.3 | 46.2 | 73.8 | |
| VLM-3R-8BOnline=false2026.06 | 60.9 | 70.2 | 49.4 | 69.2 | 67.1 | 65.4 | 80.5 | 45.4 | 40.1 | |
| Stream3D-VLM-4BOnline=true2026.06 | 55.2 | 68.6 | 38.4 | 65.9 | 56.4 | 49.9 | 54.3 | 42.3 | 66 | |
| Gemini-2.5 ProOnline=false2026.06 | 51.5 | 43.8 | 34.9 | 64.3 | 42.8 | 61.1 | 47.8 | 45.9 | 71.3 | |
| VG LLM-8BOnline=false2026.06 | 50.7 | 67.9 | 37.7 | 58.6 | 62 | 46.6 | 40.7 | 32.4 | 59.2 | |
| Spatial-MLLM-4BOnline=false2026.06 | 48.4 | 65.3 | 34.8 | 63.1 | 45.1 | 41.3 | 46.2 | 33.5 | 46.3 | |
| SpaceR-7BOnline=false2026.06 | 45.5 | 57.8 | 28.2 | 59.9 | 47.1 | 40.1 | 45.4 | 33.5 | 52.1 | |
| Gemini-1.5 ProOnline=false2026.06 | 45.4 | 56.2 | 30.9 | 64.1 | 43.6 | 51.3 | 46.3 | 36 | 34.6 | |
| LLaVA-NeXT-Video-72BOnline=false2026.06 | 40.9 | 48.9 | 22.8 | 57.4 | 35.3 | 42.4 | 36.7 | 35 | 48.6 | |
| LLaVA-OneVision-72BOnline=false2026.06 | 40.2 | 43.5 | 23.9 | 57.6 | 37.5 | 42.5 | 39.9 | 32.5 | 44.6 | |
| Qwen2.5-VL-72BOnline=false2026.06 | 37 | 25.1 | 29.3 | 54.5 | 38.8 | 38.2 | 37 | 34 | 28.9 | |
| GPT-4oOnline=false2026.06 | 34 | 46.2 | 5.3 | 43.8 | 38.2 | 37 | 41.3 | 31.5 | 28.5 | |
| Qwen2.5-VL-7BOnline=false2026.06 | 33 | 40.9 | 14.8 | 43.4 | 10.7 | 38.6 | 38.5 | 33 | 29.8 | |
| VILA-1.5-40BOnline=false2026.06 | 31.2 | 22.4 | 24.8 | 48.7 | 22.7 | 40.5 | 25.7 | 31.5 | 32.9 | |
| LongVILA-8BOnline=false2026.06 | 21.6 | 29.1 | 9.1 | 16.7 | 0 | 29.6 | 30.7 | 32.5 | 25.5 |