Spatial Reasoning on STARE (Detailed Components)
71.22D TranslationGPT-4o
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-4o2026.02 | 71.2 | 65.5 | 50.3 | 52.5 | 39 | 38.7 | 53.9 | |
| Gemini-2.0 Flash2026.02 | 69.5 | 56.1 | 37.7 | 65 | 38.6 | 37.2 | 51.3 | |
| Claude-3.5 Sonnet2026.02 | 65.9 | 51.5 | 52.3 | 59 | 54 | 26.1 | 53.1 | |
| CapImagine2026.02 | 43.2 | 35.8 | 56.5 | 49.1 | 35.9 | 25.2 | 40.7 | |
| Qwen2.5VL-7B2026.02 | 38.4 | 28.8 | 40.7 | 54.5 | 36.5 | 23.2 | 36.7 | |
| Monet2026.02 | 32.4 | 26.5 | 55.4 | 48.1 | 32.1 | 27.2 | 35.3 |