Math Reasoning on AIME 2024 (Accuracy, Avg, Delta)
91.25AccuracyFull
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FullBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 91.25 | 80.69 | — | |
| PreMoEBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 88.33 | 79.92 | -0.77 | |
| FullBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 80.83 | 79.25 | — | |
| PreMoEBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 80.41 | 78.45 | -0.8 | |
| PreMoEBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 79.58 | 76.52 | 1.01 | |
| EASY-EPBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 79.17 | 74.69 | -0.82 | |
| Act-LogitsBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 77.5 | 76.91 | -2.34 | |
| EASY-EPBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 77.2 | 76.45 | -2.8 | |
| FullBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 77.08 | 75.51 | — | |
| FrequencyBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 76.25 | 69.67 | -9.58 | |
| SEER (L)Base Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 75.41 | 71.29 | -7.96 | |
| SEER (G)Base Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 71.67 | 70.93 | -8.32 | |
| Act-LogitsBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 70 | 62.87 | -12.64 | |
| EASY-EPBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 62.46 | 54.26 | -26.43 | |
| FrequencyBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 60.83 | 49.93 | -25.58 | |
| FrequencyBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 60.42 | 54.26 | -32.76 | |
| RandomBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 41.25 | 50.13 | -29.12 | |
| RandomBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 6.67 | 26.69 | -48.82 | |
| RandomBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 5 | 13.07 | -67.62 | |
| SEER (G)Base Model=DeepSeek-R1, Sparsity=50%2025.05 | 3.33 | 24.31 | -51.2 | |
| SEER (L)Base Model=DeepSeek-R1, Sparsity=50%2025.05 | 2.91 | 23.56 | -51.95 | |
| All-LogitsBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 0 | 5.46 | -70.05 | |
| All-LogitsBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 0 | 5.39 | -73.86 | |
| All-LogitsBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.35 | -80.34 | |
| SEER (L)Base Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.64 | -80.05 | |
| SEER (G)Base Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.34 | -80.35 | |
| Act-LogitsBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.82 | -79.87 |