Spatial Reasoning on STVQA 300 samples 7k (train)
88.5Relative ScoreSpatiO
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SpatiO2026.04 | 88.5 | 78 | 93.1 | 77.5 | 89 | 85.4 | 79.4 | 78 | 92.5 | 88.2 | |
| Claude opus 4.62026.04 | 88.1 | 82 | 87.5 | 69.2 | 80.4 | 80 | 70 | 71.9 | 96.8 | 84.7 | |
| Qwen-3.0-VL-4BLoRA training=false2026.04 | 83.6 | 88 | 70.8 | 73.1 | 91.3 | 86 | 76.7 | 56.2 | 96.8 | 82.4 | |
| Qwen-3.0-VL-4BLoRA training=true2026.04 | 81.2 | 80 | 81.2 | 50 | 86.9 | 74 | 60 | 59.3 | 80.6 | 77.9 | |
| Gpt-5.22026.04 | 79.7 | 92 | 85.4 | 69.2 | 82.6 | 82 | 76.6 | 75 | 96.7 | 81.4 | |
| SpatialReasonerLoRA training=false2026.04 | 70.4 | 66 | 73 | 61 | 84.9 | 60.3 | 86.7 | 59.1 | 75.4 | 70.6 | |
| Llava-4DLoRA training=true2026.04 | 63.7 | 65.6 | 54.2 | 22.9 | 60.4 | 52.3 | 46.7 | 30.2 | 39.1 | 57.2 | |
| SpatialRGPTLoRA training=false2026.04 | 62.8 | 82 | 75 | 46.2 | 73.9 | 78 | 56.7 | 59.4 | 90.3 | 67.1 | |
| Sa2VALoRA training=true2026.04 | 62.3 | 76 | 72.9 | 53.8 | 67.4 | 74 | 50 | 68.8 | 77.4 | 65.3 | |
| SpatialRGPTLoRA training=true2026.04 | 62.1 | 84 | 74 | 37.8 | 70.9 | 83.4 | 59.3 | 66.4 | 92 | 67.1 | |
| SpatialReasonerLoRA training=true2026.04 | 60.2 | 78 | 87.5 | 38.5 | 63 | 66 | 53.3 | 62.5 | 71 | 63.4 | |
| Llava-4DLoRA training=false2026.04 | 57.8 | 54 | 58.3 | 19.2 | 58.7 | 40 | 43.3 | 34.4 | 45.2 | 52.6 | |
| Sa2VALoRA training=false2026.04 | 51.1 | 74.1 | 56.2 | 23 | 10.8 | 62 | 53.3 | 21.8 | 74.1 | 50 |