Spatial Awareness on SAT
76.7AccuracyGemini-2.5-Pro
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini-2.5-ProModel Category=General-Purpose VLMs2026.06 | 76.7 | — | |
| Embodied-R1Model Category=Embodied VLMs2026.06 | 76.3 | — | |
| RoboBrain-2.0-7BModel Category=Embodied VLMs2026.06 | 75.3 | — | |
| GPT-5.4Model Category=General-Purpose VLMs2026.06 | 74.7 | — | |
| Embodied-R1.5Model Category=Ours2026.06 | 74.7 | — | |
| MagmaModel Category=Embodied VLMs2026.06 | 71.3 | — | |
| GPT-4oModel Category=General-Purpose VLMs2026.06 | 66.7 | — | |
| Qwen3-VL-8BModel Category=General-Purpose VLMs2026.06 | 65.3 | — | |
| Gemini-Robotics-ER-1.5Model Category=Embodied VLMs2026.06 | 62.7 | — | |
| VeBrainModel Category=Embodied VLMs2026.06 | 58 | — | |
| InternVL3.5-8BModel Category=General-Purpose VLMs2026.06 | 55.3 | — | |
| Mimo-EmbodiedModel Category=Embodied VLMs2026.06 | 54.6 | — | |
| Pelican-VL-1.0Model Category=Embodied VLMs2026.06 | 54.6 | — | |
| Molmo-D-7BModel Category=General-Purpose VLMs2026.06 | 54 | — | |
| Embodied-R1-7BParameters=7B2026.06 | — | 70 | |
| InternVL3-8BParameters=8B2026.06 | — | 52.67 | |
| InternVLA-M1Parameters=M12026.06 | — | 68 | |
| Lumo-1-Stage1training_stage=Stage 12025.12 | — | 74.67 | |
| Lumo-1-Stage2training_stage=Stage 22025.12 | — | 69.33 | |
| Ours-8BParameters=8B2026.06 | — | 72 | |
| Qwen2.5-VL-32B-Instructparameters=32B, type=Instruct2025.12 | — | 69.33 | |
| Qwen2.5-VL-7B-Instructparameters=7B, type=Instruct2025.12 | — | 62.67 | |
| Qwen3-VL-8BParameters=8B2026.06 | — | 53.33 | |
| Robix 7B Baseparameters=7B, type=Base2025.12 | — | 71.1 | |
| RoboBrain-7B-2.0parameters=7B2025.12 | — | 72.67 | |
| RoboBrain2.0-7BParameters=7B2026.06 | — | 75.33 |