Coding on Eval+
87.1Eval+ ScoreFull
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FullModel=Qwen3, Pruning Ratio=0%2026.06 | 87.1 | — | |
| FullModel=ERNIE, Pruning Ratio=0%2026.06 | 86.7 | — | |
| MANModel=Qwen3, Pruning Ratio=50%2026.06 | 85 | — | |
| FrequencyModel=ERNIE, Pruning Ratio=25%2026.06 | 81.8 | — | |
| BaselineModel=Qwen3-30B-A3B, Compression=Baseline2025.10 | 81.4 | 55.8 | |
| FrequencyModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 80.5 | 55.3 | |
| EANModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 79.7 | 55.4 | |
| REAPModel=Qwen3-30B-A3B, Compression=25%, Technique=Pruning2025.10 | 79.7 | 55.1 | |
| BaselineModel=GLM-4.5-Air, Compression=Baseline2025.10 | 78.6 | 58 | |
| M-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.10 | 78.1 | 53.7 | |
| REAPModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 78 | 54.1 | |
| EANModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 76.8 | 57.1 | |
| FrequencyModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 75.9 | 55 | |
| REAPModel=GLM-4.5-Air, Compression=25%, Technique=Pruning2025.10 | 75.9 | 58.5 | |
| EANModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 75.3 | 53 | |
| HC-SMoEModel=Qwen3-30B-A3B, Compression=25%, Technique=Merging2025.10 | 75.2 | 50.5 | |
| HC-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.10 | 73.7 | 55 | |
| M-SMoEModel=GLM-4.5-Air, Compression=25%, Technique=Merging2025.10 | 72.6 | 52.8 | |
| EANModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 72.1 | 48.7 | |
| MANModel=ERNIE, Pruning Ratio=50%2026.06 | 71.6 | — | |
| REAPModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 67.9 | 51.5 | |
| FrequencyModel=Qwen3-30B-A3B, Compression=50%, Technique=Pruning2025.10 | 66.8 | 45.2 | |
| HC-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.10 | 61.8 | 41.9 | |
| M-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.10 | 59 | 39.7 | |
| FullModel=DeepSeek, Pruning Ratio=0%2026.06 | 54.9 | — | |
| HC-SMoEModel=Qwen3-30B-A3B, Compression=50%, Technique=Merging2025.10 | 54.3 | 36.4 | |
| FrequencyModel=GLM-4.5-Air, Compression=50%, Technique=Pruning2025.10 | 51.1 | 30.8 | |
| M-SMoEModel=GLM-4.5-Air, Compression=50%, Technique=Merging2025.10 | 46.8 | 28.4 | |
| REAPModel=DeepSeek, Pruning Ratio=25%2026.06 | 46.5 | — | |
| MANModel=DeepSeek, Pruning Ratio=25%2026.06 | 44.4 | — | |
| (0,2,2)Model=DeepSeek, Pruning Ratio=25%2026.06 | 44.2 | — | |
| EANModel=DeepSeek, Pruning Ratio=25%2026.06 | 44 | — | |
| (0,1,1)Model=DeepSeek, Pruning Ratio=25%2026.06 | 43.5 | — | |
| MSANModel=DeepSeek, Pruning Ratio=25%2026.06 | 41.1 | — | |
| MoNEModel=DeepSeek, Pruning Ratio=25%2026.06 | 40.6 | — | |
| SEERModel=DeepSeek, Pruning Ratio=25%2026.06 | 40.4 | — | |
| (0,2,2)Model=OLMoE, Pruning Ratio=25%2026.06 | 34.8 | — | |
| EANModel=OLMoE, Pruning Ratio=25%2026.06 | 34.5 | — | |
| FullModel=OLMoE, Pruning Ratio=0%2026.06 | 34.1 | — | |
| FrequencyModel=OLMoE, Pruning Ratio=25%2026.06 | 34.1 | — | |
| SEERModel=OLMoE, Pruning Ratio=25%2026.06 | 33.9 | — | |
| MoNEModel=OLMoE, Pruning Ratio=25%2026.06 | 33.9 | — | |
| (0,1,1)Model=OLMoE, Pruning Ratio=25%2026.06 | 33.3 | — | |
| REAPModel=OLMoE, Pruning Ratio=25%2026.06 | 30 | — | |
| FrequencyModel=DeepSeek, Pruning Ratio=25%2026.06 | 29.7 | — | |
| MSANModel=OLMoE, Pruning Ratio=25%2026.06 | 25.4 | — | |
| MANModel=OLMoE, Pruning Ratio=25%2026.06 | 24.3 | — |