Math Reasoning on CNMO 2024 (accuracy, Avg, Delta)
81.94AccuracyPreMoE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PreMoEBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 81.94 | 79.92 | -0.77 | |
| PreMoEBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 79.17 | 78.45 | -0.8 | |
| FullBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 78.65 | 80.69 | — | |
| FullBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 77.43 | 79.25 | — | |
| FrequencyBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 75.69 | 69.67 | -9.58 | |
| PreMoEBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 75 | 76.52 | 1.01 | |
| SEER (L)Base Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 73.61 | 71.29 | -7.96 | |
| EASY-EPBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 73.43 | 76.45 | -2.8 | |
| SEER (G)Base Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 72.4 | 70.93 | -8.32 | |
| Act-LogitsBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 72.4 | 76.91 | -2.34 | |
| EASY-EPBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 72.18 | 74.69 | -0.82 | |
| FullBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 71.18 | 75.51 | — | |
| FrequencyBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 64.58 | 49.93 | -25.58 | |
| Act-LogitsBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 62.62 | 62.87 | -12.64 | |
| FrequencyBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 54.69 | 54.26 | -32.76 | |
| RandomBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 54.51 | 50.13 | -29.12 | |
| EASY-EPBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 52.65 | 54.26 | -26.43 | |
| SEER (L)Base Model=DeepSeek-R1, Sparsity=50%2025.05 | 36.63 | 23.56 | -51.95 | |
| SEER (G)Base Model=DeepSeek-R1, Sparsity=50%2025.05 | 36.63 | 24.31 | -51.2 | |
| RandomBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 30.88 | 26.69 | -48.82 | |
| RandomBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 7.99 | 13.07 | -67.62 | |
| All-LogitsBase Model=openPangu-Ultra, Sparsity=31.25%2025.05 | 2.95 | 5.39 | -73.86 | |
| All-LogitsBase Model=DeepSeek-R1, Sparsity=50%2025.05 | 0.35 | 5.46 | -70.05 | |
| All-LogitsBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.35 | -80.34 | |
| SEER (L)Base Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.64 | -80.05 | |
| SEER (G)Base Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.34 | -80.35 | |
| Act-LogitsBase Model=Qwen3-30B-A3B, Sparsity=50%2025.05 | 0 | 0.82 | -79.87 |