3D Spatial Reasoning on OMNI3D-BENCH (zero-shot)
44AccuracyVALOR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VALORModel Category=Open-Source, Tool Use=true2025.12 | 44 | — | — | — | — | |
| VALOR-RLModel Category=Open-Source, Tool Use=true2025.12 | 43.9 | — | — | — | — | |
| Claude-3.5-HaikuModel Category=Proprietary, Tool Use=true2025.12 | 43.6 | — | — | — | — | |
| GPT-4oModel Category=Proprietary, Tool Use=true2025.12 | 38 | — | — | — | — | |
| Qwen3-8BModel Category=Open-Source, Tool Use=true2025.12 | 37.5 | — | — | — | — | |
| Gemini-2.5-FlashModel Category=Proprietary, Tool Use=true2025.12 | 37.1 | — | — | — | — | |
| Gemini-2.0-FlashModel Category=Proprietary, Tool Use=true2025.12 | 37 | — | — | — | — | |
| o4-miniModel Category=Proprietary, Tool Use=true2025.12 | 35.6 | — | — | — | — | |
| Llama-3.2-11BModel Category=Open-Source, Tool Use=true2025.12 | 32 | — | — | — | — | |
| Gemma-3-12BModel Category=Open-Source, Tool Use=true2025.12 | 24.4 | — | — | — | — | |
| Llava-4Dzero-shot=true2026.04 | — | — | 17.2 | 3.9 | 1.2 | |
| Qwen-3.0-VL-4Bzero-shot=true2026.04 | — | — | 23.2 | 12.3 | 18 | |
| Sa2VAzero-shot=true2026.04 | — | — | 13.6 | 2.9 | 0 | |
| SpatialReasonerzero-shot=true2026.04 | — | — | 18.5 | 4.3 | 1.2 | |
| SpatialRGPTzero-shot=true2026.04 | — | — | 3.1 | 5.4 | 19.2 | |
| SpatiOzero-shot=true2026.04 | — | — | 40.3 | 32.9 | 20 |