Visual Question Answering on 6-DoF SpatialBench 1.0 (test)
24.5Rel. Position ErrorGPT-3.5-Turbo
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-3.5-TurboDepth-Esti=false2025.02 | 24.5 | 24.9 | 26.7 | 27.5 | 25.7 | |
| GPT-4-TurboDepth-Esti=false2025.02 | 27.2 | 27.3 | 29.2 | 27.9 | 27.8 | |
| LLaVA-1.5Depth-Esti=false2025.02 | 30.9 | 24.5 | 28.3 | 25.8 | 27.2 | |
| SpaceLLaVADepth-Esti=false2025.02 | 32.4 | 30.5 | 30.9 | 24.9 | 28.2 | |
| GPT-4o-miniDepth-Esti=false2025.02 | 33.3 | 26.9 | 32.5 | 23.8 | 31 | |
| SpaceMantisDepth-Esti=false2025.02 | 33.6 | 29.2 | 27.2 | 25 | 28.9 | |
| RoboPointDepth-Esti=false2025.02 | 43.8 | 30.8 | 33.8 | 25.8 | 33.5 | |
| GPT-4oDepth-Esti=false2025.02 | 49.4 | 28.4 | 44.2 | 25.8 | 36.2 | |
| SpatialBotDepth-Esti=true2025.02 | 50.9 | 21.6 | 39.6 | 22.9 | 32.7 | |
| SOFARDepth-Esti=true2025.02 | 59.6 | 33.8 | 54.6 | 31.3 | 43.9 |