List your company
ResearchFormerly WizWand

Mathematical Reasoning on AIME 25 (Accuracy (pass@1))

37.29Accuracy (pass@1)Critique
21.804425.824729.84533.8653Jun 12, 2025
Updated 6mo ago

Evaluation results

MethodLinks
CritiqueBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.0637.29
WaitBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.0636.77
AlternativelyBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.0636.51
HmmBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.0636.51
Baseline (w/o BF)Backbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.0636.41
LearnedBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.0636.09
WaitBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.0630.26
LearnedBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.0630.26
HmmBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.0630.1
CritiqueBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.0629.9
AlternativelyBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.0629.64
Baseline (w/o BF)Backbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.0629.32
HmmBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.0623.85
AlternativelyBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.0623.8
WaitBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.0623.49
Baseline (w/o BF)Backbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.0623.33
CritiqueBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.0622.45
LearnedBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.0622.4