Spatial Reasoning on BLINK (val)
61.4AccuracyGemini
Evaluation results
| Method | Links | |
|---|---|---|
| GeminiZero-shot=true2025.02 | 61.4 | |
| GPT-4oZero-shot=true2025.02 | 60 | |
| Magma-8B (Full)Zero-shot=true, SoM/ToM pre-training=with2025.02 | 41 | |
| Qwen-VL-9.6BZero-shot=true2025.02 | 40.3 | |
| Magma-8B (Full)Zero-shot=true, SoM/ToM pre-training=without2025.02 | 38.3 | |
| LLaVA-1.5-7BZero-shot=true2025.02 | 37.1 | |
| Magma-8B (Act)Zero-shot=true, SoM/ToM pre-training=without2025.02 | 30.1 |