List your company
ResearchFormerly WizWand

Math Reasoning on AIME 2025 (Accuracy, Avg, Delta)

82.92AccuracyFull
-3.316819.071641.4663.8484May 23, 2025
Updated 7mo ago

Evaluation results

MethodLinks
FullBase Model=Qwen3-30B-A3B, Sparsity=50%2025.0582.9280.69—
PreMoEBase Model=Qwen3-30B-A3B, Sparsity=50%2025.0579.5879.92-0.77
FullBase Model=openPangu-Ultra, Sparsity=31.25%2025.0575.4279.25—
Act-LogitsBase Model=openPangu-Ultra, Sparsity=31.25%2025.0573.3376.91-2.34
EASY-EPBase Model=openPangu-Ultra, Sparsity=31.25%2025.0572.1776.45-2.8
PreMoEBase Model=openPangu-Ultra, Sparsity=31.25%2025.0571.6778.45-0.8
SEER (G)Base Model=openPangu-Ultra, Sparsity=31.25%2025.0569.1770.93-8.32
EASY-EPBase Model=DeepSeek-R1, Sparsity=50%2025.0568.3374.69-0.82
PreMoEBase Model=DeepSeek-R1, Sparsity=50%2025.0568.3376.521.01
FullBase Model=DeepSeek-R1, Sparsity=50%2025.0565.8375.51—
FrequencyBase Model=openPangu-Ultra, Sparsity=31.25%2025.0565.8369.67-9.58
SEER (L)Base Model=openPangu-Ultra, Sparsity=31.25%2025.0562.0871.29-7.96
Act-LogitsBase Model=DeepSeek-R1, Sparsity=50%2025.055562.87-12.64
FrequencyBase Model=Qwen3-30B-A3B, Sparsity=50%2025.0546.6754.26-32.76
FrequencyBase Model=DeepSeek-R1, Sparsity=50%2025.0546.1949.93-25.58
EASY-EPBase Model=Qwen3-30B-A3B, Sparsity=50%2025.0544.9254.26-26.43
RandomBase Model=openPangu-Ultra, Sparsity=31.25%2025.0534.1750.13-29.12
RandomBase Model=Qwen3-30B-A3B, Sparsity=50%2025.052.9213.07-67.62
SEER (L)Base Model=DeepSeek-R1, Sparsity=50%2025.052.0823.56-51.95
SEER (G)Base Model=DeepSeek-R1, Sparsity=50%2025.051.6724.31-51.2
RandomBase Model=DeepSeek-R1, Sparsity=50%2025.051.2526.69-48.82
All-LogitsBase Model=DeepSeek-R1, Sparsity=50%2025.0505.46-70.05
All-LogitsBase Model=openPangu-Ultra, Sparsity=31.25%2025.0505.39-73.86
All-LogitsBase Model=Qwen3-30B-A3B, Sparsity=50%2025.0500.35-80.34
SEER (L)Base Model=Qwen3-30B-A3B, Sparsity=50%2025.0500.64-80.05
SEER (G)Base Model=Qwen3-30B-A3B, Sparsity=50%2025.0500.34-80.35
Act-LogitsBase Model=Qwen3-30B-A3B, Sparsity=50%2025.0500.82-79.87