List your company
ResearchFormerly WizWand

Mathematics on MATH-500 (test)

80.2Score (%)Full
-2.58418.90840.461.892Jun 6, 2026Jun 7, 2026Jun 8, 2026Jun 10, 2026Jun 11, 2026Jun 12, 2026Jun 14, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FullModel=Qwen3, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0680.2
MSANModel=Qwen3, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0679.6
MANModel=Qwen3, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0679.2
FullModel=ERNIE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0678
REAPModel=Qwen3, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0677.8
MANModel=ERNIE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.0658
MSANModel=ERNIE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0656.4
FReDA-4BNumber of shots=4, Evaluation protocol=Best-of-N2026.0653
REAPModel=ERNIE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.0652.8
Qwen3-4B-BaseNumber of shots=42026.0652.6
FReDA-4BNumber of shots=4, Evaluation protocol=Self-refine2026.0651.98
BlockDiff-4BNumber of shots=42026.0650.6
Qwen2.5-3B-BaseNumber of shots=42026.0642.6
LLaDA-MoE-7B-A1B-BaseNumber of shots=42026.0641.2
LLaDA-8B-BaseNumber of shots=42026.0639.6
Dream-7B-BaseNumber of shots=42026.0639.2
MoNEModel=ERNIE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.0638.4
EANModel=ERNIE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.0637
SEERModel=ERNIE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.0636.8
FrequencyModel=ERNIE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.0631.6
FullModel=DeepSeek, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0629.8
FullModel=OLMoE, Pruning Ratio=0%, Criterion=Full, Calibration=C42026.0622.2
MoNEModel=Qwen3, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.0620.6
SEERModel=Qwen3, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.0620.2
FrequencyModel=Qwen3, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.0619.6
EANModel=Qwen3, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.0619.4
DiffuLLaMA-7BNumber of shots=42026.0611
MSANModel=DeepSeek, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.0610.2
MSANModel=OLMoE, Pruning Ratio=25%, Criterion=MSAN, (b, α, β)=(1, 0, 2), Calibration=C42026.065.6
MANModel=OLMoE, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.064.6
REAPModel=OLMoE, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.063.6
MANModel=DeepSeek, Pruning Ratio=25%, Criterion=MAN, (b, α, β)=(1, 0, 1), Calibration=C42026.063.2
EANModel=DeepSeek, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.062.8
REAPModel=DeepSeek, Pruning Ratio=25%, Criterion=REAP, (b, α, β)=(1, 1, 1), Calibration=C42026.062.8
FrequencyModel=OLMoE, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.062.4
MoNEModel=DeepSeek, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.062.4
SEERModel=DeepSeek, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.061.6
SEERModel=OLMoE, Pruning Ratio=25%, Criterion=SEER, (b, α, β)=(0, 1, 0), Calibration=C42026.061.2
EANModel=OLMoE, Pruning Ratio=25%, Criterion=EAN, (b, α, β)=(0, 0, 1), Calibration=C42026.061.2
FrequencyModel=DeepSeek, Pruning Ratio=25%, Criterion=Frequency, (b, α, β)=(0, 0, 0), Calibration=C42026.061.2
MoNEModel=OLMoE, Pruning Ratio=25%, Criterion=MoNE, Calibration=C42026.060.6