List your company

Mathematical Reasoning on MathVista (ALL, ARI, LOG, STA, VQA Scores)

64.2ALL ScoreAStar
16.04828.54941.0553.551Feb 4, 2025

Evaluation results

MethodLinks
AStarBackbone=Qwen2.5-7B, Training-free=true2025.0264.263.859.569.160.9
R1-VL-7B2025.0263.554.728.561.260.9
AStarBackbone=Qwen2-VL-7B, Training-free=true2025.0261.760.628.668.459.6
Human2025.0260.359.240.763.955.9
GPT-4o2025.0260.158.4276949.2
URSA-8B2025.0259.853.521.657.140.2
Qwen2-VL-7B2025.0258.957.524.343.158.1
InternVL2-8B2025.0258.356.410.868.849.7
MultiMath-7B2025.025042.223.364.949.2
Math-PUMA-7B2025.0247.946.221.655.830.2
Math-LLaVA-13B2025.0246.640.723.342.333.5
LLaVA-NeXT-34B2025.0246.5————
SPHINX-8x7B2025.0242.64314.450.843.3
SPHINX-V2-13B2025.0236.733.424.351.543
LLaVA-1.5-13B2025.0227.728.610.822.930.2
MiniGPT4-7B2025.0223.13210.817.930.2
Random2025.0217.913.813.414.326.3