Spatial Reasoning on EmbSp (test)
69.3Test AccuracyRoboBrain-7B
Evaluation results
| Method | Links | |
|---|---|---|
| RoboBrain-7BModel Category=Open-source models, Rank=4.42025.08 | 69.3 | |
| Embodied-R1Model Category=Open-source models, Rank=2.12025.08 | 67.4 | |
| Embodied-R1 w/o CSModel Category=Open-source models, Rank=3.42025.08 | 65.4 | |
| FSD-13BModel Category=Open-source models, Rank=4.62025.08 | 63.3 | |
| Embodied-SFTModel Category=Open-source models, Rank=3.72025.08 | 63.1 | |
| Qwen2.5VL-3BModel Category=Open-source models, Rank=5.62025.08 | 62.8 | |
| ASMv2-13BModel Category=Open-source models, Rank=7.22025.08 | 57.4 | |
| RoboPoint-13BModel Category=Open-source models, Rank=7.22025.08 | 51.4 | |
| SAT-Dynamic-13BModel Category=Open-source models, Rank=6.62025.08 | 51.3 | |
| GPT4oModel Category=Closed-source models2025.08 | 49.1 | |
| GPT4VModel Category=Closed-source models2025.08 | 36.1 | |
| LLaVA-1.5-13BModel Category=Open-source models, Rank=9.42025.08 | 35.1 |