Spatial Reasoning on STVQA-7k (test)
79.3Relative Position AccuracySpatiO
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SpatiOOptimization Dataset=CV-Bench, Optimization Samples=150, Evaluation Mode=Zero-shot generalization2026.04 | 79.3 | 85.5 | 85 | 73.1 | 76.1 | 84 | 73.3 | 63.1 | 87.1 | 79.3 | |
| Qwen-3.0-VL-4BOptimization Dataset=CV-Bench, Optimization Samples=150, Evaluation Mode=Zero-shot generalization2026.04 | 75.7 | 82 | 77.5 | 76.9 | 80.4 | 85 | 83.3 | 68.7 | 93.5 | 78.7 | |
| Sa2VAOptimization Dataset=CV-Bench, Optimization Samples=150, Evaluation Mode=Zero-shot generalization2026.04 | 72 | 82 | 79.1 | 69.2 | 80.4 | 78 | 56.6 | 62.5 | 96.7 | 74.1 | |
| SpatialReasonerOptimization Dataset=CV-Bench, Optimization Samples=150, Evaluation Mode=Zero-shot generalization2026.04 | 72 | 82 | 79.1 | 65.3 | 73.9 | 72 | 63.3 | 46.8 | 74.1 | 71.6 | |
| Llava-4DOptimization Dataset=CV-Bench, Optimization Samples=150, Evaluation Mode=Zero-shot generalization2026.04 | 56.9 | 66 | 45.8 | 15.3 | 50 | 72 | 40 | 40.6 | 90.3 | 55.9 | |
| SpatialRGPTOptimization Dataset=CV-Bench, Optimization Samples=150, Evaluation Mode=Zero-shot generalization2026.04 | 34.2 | 36 | 31.2 | 19.2 | 23.9 | 24 | 33.3 | 46.2 | 51.6 | 33.3 |