Embodied reasoning on Quantiphy (val)
37.36Overall AccuracyGeoSense
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GeoSensesize=4B2026.03 | 37.36 | 36.56 | 35.41 | 31.39 | 44.89 | |
| SpatialLaddersize=3B2026.03 | 36.86 | 34.06 | 34.59 | 33.72 | 43.4 | |
| Qwen2.5-VLsize=3B, variant=Instruct2026.03 | 36.79 | 37.81 | 44.32 | 27.91 | 38.3 | |
| Qwen3-VLsize=4B, variant=Instruct2026.03 | 36.6 | 26.56 | 32.7 | 29.77 | 52.77 | |
| VSTsize=3B, variant=SFT2026.03 | 33.77 | 22.5 | 29.19 | 29.77 | 48.72 | |
| VG-LLMsize=4B2026.03 | 31.13 | 34.06 | 36.76 | 17.67 | 37.02 | |
| Qwen3-VLsize=2B, variant=Instruct2026.03 | 30.44 | 19.69 | 31.62 | 23.02 | 43.62 | |
| InternVL3size=2B2026.03 | 29.25 | 21.88 | 27.3 | 25.58 | 39.15 |