Spatial relationship understanding on VSR zeroshot
69.25AccuracyGemma3-27B-IT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma3-27B-ITModel scale=27B2026.06 | 69.25 | 70.7 | |
| Thinking with Grounding BoxModel scale=4B, Grounding interface=Box, Grounding reward=w/2026.06 | 68.08 | 86.91 | |
| Gemma3-12B-ITModel scale=12B2026.06 | 67.98 | 69.56 | |
| Thinking with Grounding BoxModel scale=4B, Grounding interface=Box, Grounding reward=w/o2026.06 | 66.82 | 87.64 | |
| Thinking with Grounding PointModel scale=4B, Grounding interface=Point, Grounding reward=w/o2026.06 | 65.38 | 83.88 | |
| Thinking with Grounding PointModel scale=4B, Grounding interface=Point, Grounding reward=w/2026.06 | 64.67 | 81.42 | |
| Gemma3-4B-ITModel scale=4B2026.06 | 56.65 | 57.94 | |
| Non-grounded ThinkingModel scale=4B, Grounding interface=None2026.06 | 51.84 | 79.13 |