List your company
ResearchFormerly WizWand

Mathematical Reasoning on MATH500 (vbal)

0.778VBAL ScoreBase
-0.04880.165850.38050.59515Apr 6, 2026
Updated 6mo ago

Evaluation results

MethodLinks
BaseModel=Tulu3.1-8B2026.040.778
BaseModel=Llama3.1-8B2026.040.763
BaseModel=OLMo2-7B2026.040.734
Reflect-and-rephraseModel=OLMo2-7B2026.040.061
Reflect-and-rephraseModel=Llama3.1-8B2026.040.04
STRUCT.Model=OLMo2-7B2026.040.03
PROF.Model=Llama3.1-8B2026.040.028
PROF.Model=OLMo2-7B2026.040.026
Reflect-and-rephraseModel=Tulu3.1-8B2026.040.024
SIMPL.Model=OLMo2-7B2026.040.02
STRUCT.Model=Llama3.1-8B2026.040.012
SIMPL.Model=Llama3.1-8B2026.040.002
PROF.Model=Tulu3.1-8B2026.04-0.003
STRUCT.Model=Tulu3.1-8B2026.04-0.01
SIMPL.Model=Tulu3.1-8B2026.04-0.017