Visual Reasoning on ROBOSPATIAL
69.5AccuracyVALOR
Evaluation Results
| Method | Links | |
|---|---|---|
| VALORModel Category=Open-Source, Tool Use=true2025.12 | 69.5 | |
| Gemini-2.5-FlashModel Category=Proprietary, Tool Use=true2025.12 | 68.7 | |
| o4-miniModel Category=Proprietary, Tool Use=true2025.12 | 61.8 | |
| VALOR-RLModel Category=Open-Source, Tool Use=true2025.12 | 61.8 | |
| Qwen3-8BModel Category=Open-Source, Tool Use=true2025.12 | 60.5 | |
| Llama-3.2-11BModel Category=Open-Source, Tool Use=true2025.12 | 58.3 | |
| Gemini-2.0-FlashModel Category=Proprietary, Tool Use=true2025.12 | 57 | |
| GPT-4oModel Category=Proprietary, Tool Use=true2025.12 | 56.6 | |
| Claude-3.5-HaikuModel Category=Proprietary, Tool Use=true2025.12 | 55.7 | |
| Gemma-3-12BModel Category=Open-Source, Tool Use=true2025.12 | 54 |