Spatial Reasoning on What’sUp+VSR Combined suite (test)
99.51Ctrl-A ScoreGeoWorld-VLM
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GeoWorld-VLMBackbone=Gemma4, Adaptation Method=World-model alignment and interface preservation2026.05 | 99.51 | 93.14 | 37.46 | 70.45 | 78.28 | 76.71 | 80.17 | 65.45 | |
| GeoWorld-VLMBackbone=InternVL3.5-2B, Adaptation Method=World-model alignment and interface preservation2026.05 | 99.51 | 99.51 | 35.77 | 60.91 | 70.52 | 45.89 | 80.34 | 61.66 | |
| Gemma4 + FTBackbone=Gemma4, Adaptation Method=Task-only fine-tuning2026.05 | 99.03 | 92.16 | 34.79 | 66.82 | 77.24 | 69.86 | 75.56 | 62.71 | |
| InternVL3.5-2B + FTBackbone=InternVL3.5-2B, Adaptation Method=Task-only fine-tuning2026.05 | 98.54 | 96.08 | 31.76 | 55 | 61.38 | 41.1 | 83.59 | 58.14 | |
| Gemma4 + DINOBackbone=Gemma4, Adaptation Method=DINOv3-based static feature distillation2026.05 | 97.57 | 94.61 | 36.74 | 68.64 | 78.1 | 70.55 | 78.63 | 64.4 | |
| InternVL3.5-2B + DINOBackbone=InternVL3.5-2B, Adaptation Method=DINOv3-based static feature distillation2026.05 | 97.57 | 99.51 | 29.54 | 52.73 | 51.38 | 29.45 | 83.25 | 54.81 | |
| Gemma4Backbone=Gemma4, Adaptation Method=Base2026.05 | 94.17 | 79.9 | 40.57 | 64.55 | 69.14 | 68.49 | 74.36 | 61.7 | |
| InternVL3.5-2BBackbone=InternVL3.5-2B, Adaptation Method=Base2026.05 | 64.08 | 81.37 | 40.12 | 60 | 65.69 | 41.78 | 72.82 | 57.06 |