Zero-shot Evaluation on 9 Downstream Tasks (Arc-c, Arc-e, BoolQ, COPA, MMLU, OBQA, PIQA, RTE, Winogrande)
49.32Arc-cRS
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| RSPruning ratio=25%, Backbone=Deepseek-V2-Lite2025.07 | 49.32 | 74.41 | 69.39 | 90 | 50.35 | 43.8 | 80.14 | 62.09 | 70.24 | 65.53 | |
| Deepseek-V2-LitePruning ratio=0%, Backbone=Deepseek-V2-Lite2025.07 | 48.72 | 76.18 | 79.88 | 88 | 54.96 | 43.6 | 80.25 | 61.37 | 71.51 | 67.16 | |
| MoNEPruning ratio=25%, Backbone=Deepseek-V2-Lite2025.07 | 46.67 | 74.62 | 78.47 | 90 | 49.05 | 43 | 79.76 | 62.09 | 71.43 | 66.12 | |
| FLAPPruning ratio=25%, Backbone=Deepseek-V2-Lite2025.07 | 43.69 | 71.46 | 75.26 | 84 | 47.28 | 41.4 | 78.18 | 62.82 | 67.72 | 63.53 | |
| MC-SMoEPruning ratio=25%, Backbone=Deepseek-V2-Lite2025.07 | 36.69 | 60.77 | 71.31 | 84 | 42.22 | 36.6 | 75.57 | 58.48 | 68.67 | 59.37 | |
| AngularPruning ratio=25%, Backbone=Deepseek-V2-Lite2025.07 | 32 | 53.28 | 64.92 | 75 | 26.95 | 34 | 71.33 | 58.84 | 61.01 | 53.04 |