2D Spatial Reasoning on VSR
75.6AccuracyVALOR
Evaluation results
| Method | Links | |
|---|---|---|
| VALORModel Category=Open-Source, Tool Use=true2025.12 | 75.6 | |
| VALOR-RLModel Category=Open-Source, Tool Use=true2025.12 | 70.3 | |
| o4-miniModel Category=Proprietary, Tool Use=true2025.12 | 68.5 | |
| Gemini-2.5-FlashModel Category=Proprietary, Tool Use=true2025.12 | 68.5 | |
| Qwen3-8BModel Category=Open-Source, Tool Use=true2025.12 | 68.2 | |
| GPT-4oModel Category=Proprietary, Tool Use=true2025.12 | 67.4 | |
| Gemini-2.0-FlashModel Category=Proprietary, Tool Use=true2025.12 | 58.5 | |
| Llama-3.2-11BModel Category=Open-Source, Tool Use=true2025.12 | 58.5 | |
| Gemma-3-12BModel Category=Open-Source, Tool Use=true2025.12 | 57.9 | |
| Claude-3.5-HaikuModel Category=Proprietary, Tool Use=true2025.12 | 51.5 |