Spatial Reasoning on SpatialMosaic-Bench 1.0 (test)
81.8Average ScoreSpatialMosaicVLM (7B)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SpatialMosaicVLM (7B)Rank=1, Parameters=7B, Training Data=SpatialMosaic-Bench2025.12 | 81.8 | 89.9 | 72.9 | 81.5 | 74.3 | 84 | 100 | |
| VLM-3R (7B)Rank=2, Parameters=7B, Training Data=SpatialMosaic-Bench2025.12 | 81.7 | 89.8 | 73 | 81.2 | 74.2 | 83.6 | 100 | |
| VLM-3R (7B)Rank=3, Parameters=7B, Training Data=VSTI-Bench2025.12 | 49.3 | 51.9 | 36.6 | 61.4 | 42.2 | 51.4 | 38.3 | |
| VILA-1.5-40BRank=4, Parameters=40B2025.12 | 48.5 | 56 | 50.7 | 58.9 | 31.6 | 54.2 | 40.6 | |
| LLaVA-NeXT-Video-7BRank=5, Parameters=7B2025.12 | 47.8 | 61.1 | 41 | 45.7 | 34.2 | 54.6 | 37.2 | |
| InternVL2-8BRank=6, Parameters=8B2025.12 | 46 | 61.6 | 49 | 54.4 | 38.6 | 39.8 | 43.3 | |
| LLaVA-OneVision-7BRank=7, Parameters=7B2025.12 | 42.8 | 58.5 | 37.5 | 56.1 | 32.6 | 37.9 | 37.8 | |
| InternVL2-2BRank=8, Parameters=2B2025.12 | 39.9 | 65.8 | 49.4 | 47.8 | 26.4 | 34.8 | 53.1 | |
| VILA-1.5-8BRank=9, Parameters=8B2025.12 | 38.7 | 40.2 | 24.7 | 52.5 | 32.5 | 37.5 | 32.4 | |
| LongVA-7BRank=10, Parameters=7B2025.12 | 38.2 | 34.5 | 27.5 | 57.4 | 24.2 | 42.4 | 26.2 | |
| LLaVA-OneVision-0.5BRank=11, Parameters=0.5B2025.12 | 37.7 | 29.5 | 44.4 | 55.3 | 20.7 | 37.7 | 38.3 |