Spatial Reasoning on ViewSpatial-Bench (test)
55.5C-OVOS-AGENT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| S-AGENTSetting=Zero-shot2026.06 | 55.5 | 62.5 | 42.2 | 81.1 | 60.6 | 60 | |
| BAGEL-7B-MoTSetting=Zero-shot2026.06 | 38.7 | 48.3 | 47 | 42.5 | 26.5 | 41.3 | |
| VST-3B-SFTSetting=Zero-shot2026.06 | 35.4 | 46.9 | 70.3 | 52.6 | 62.8 | 52.9 | |
| Gemini 2.5 ProSetting=Zero-shot2026.06 | 33 | 59.1 | 51 | 45.8 | 32.6 | 46.1 | |
| Gemini 3 ProSetting=Zero-shot2026.06 | 31.6 | 61.9 | 41.1 | 74.4 | 38.9 | 50.4 | |
| Qwen3-VL-8B-InstructSetting=Zero-shot2026.06 | 29.7 | 54.2 | 47.3 | 40.3 | 31.1 | 42.2 | |
| VST-7B-SFTSetting=Zero-shot2026.06 | 29.6 | 52.7 | 51.9 | 50.7 | 64.5 | 50.5 | |
| GPT-5.4Setting=Zero-shot2026.06 | 27.9 | 60.2 | 41 | 48.5 | 40.1 | 45.6 | |
| Seed 1.6Setting=Zero-shot2026.06 | 26.9 | 55.8 | 54.8 | 48.5 | 26.6 | 43.9 | |
| SN-SI-1.1-Qwen2.5VL-7BSetting=Zero-shot2026.06 | 26.7 | 47.9 | 57.1 | 43.2 | 49.7 | 45.5 | |
| InternVL3_5-8BSetting=Zero-shot2026.06 | 24.7 | 49.8 | 50.3 | 34.6 | 32.9 | 40 | |
| Grok-4Setting=Zero-shot2026.06 | 23.9 | 57.1 | 47.6 | 51.7 | 24.9 | 43.2 | |
| Cambrian-S-7BSetting=Zero-shot2026.06 | 22.7 | 50.4 | 45 | 38.8 | 41.9 | 41.3 | |
| SN-SI-1.1-Qwen3VL-8BSetting=Zero-shot2026.06 | 22 | 60.3 | 67.8 | 41.5 | 55.6 | 51.2 |