List your company
ResearchFormerly WizWand

Math Reasoning on AIME 24 (Accuracy and Delta)

23.3AccuracyETO
-0.9325.35911.6517.941May 11, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ETOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=true2026.0523.310
ED-iDPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=true2026.0523.310
ED-GRPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=false2026.0523.310
ED-GRPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=true2026.0523.310
GRPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=true2026.05206.7
CoTBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=true2026.0516.73.4
ETOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=false2026.0516.73.4
GRPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=false2026.0516.73.4
DAPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=false2026.0516.73.4
DAPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=true2026.0516.73.4
ED-iDPOBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=false2026.0516.73.4
CoTBase Model=Qwen2.5-7B-Instruct-SFT, Self-Consistency=false2026.0513.3—
ETOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=true2026.056.76.7
ED-iDPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=false2026.056.76.7
ED-iDPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=true2026.056.76.7
CoTBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=true2026.053.33.3
ETOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=false2026.053.33.3
GRPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=false2026.053.33.3
GRPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=true2026.053.33.3
DAPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=false2026.053.33.3
DAPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=true2026.053.33.3
ED-GRPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=false2026.053.33.3
ED-GRPOBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=true2026.053.33.3
CoTBase Model=LLaMA3.1-8B-Instruct-SFT, Self-Consistency=false2026.050—