Zero-shot Natural Language Understanding Suite (ARC, BoolQ, COPA, MMLU, OBQA, PIQA, RTE, Winogrande)
56.14ARC-cMoNE
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| MoNEPruning ratio=25%, Base Model=Qwen3-30B-A3B, Evaluation Protocol=Zero-shot, Calibration Samples=1002025.07 | 56.14 | 79.17 | 89.11 | 85 | 74.04 | 43 | 79.27 | 77.98 | 70.48 | 72.69 | |
| Qwen3-30B-A3BPruning ratio=0%, Base Model=Qwen3-30B-A3B, Evaluation Protocol=Zero-shot, Calibration Samples=1002025.07 | 55.89 | 79.42 | 88.69 | 84 | 77.82 | 44.8 | 80.3 | 82.31 | 70.64 | 73.76 | |
| RSPruning ratio=25%, Base Model=Qwen3-30B-A3B, Evaluation Protocol=Zero-shot, Calibration Samples=1002025.07 | 53.75 | 78.32 | 88.53 | 85 | 74.6 | 43 | 79.92 | 79.78 | 69.61 | 72.5 | |
| MC-SMoEPruning ratio=25%, Base Model=Qwen3-30B-A3B, Evaluation Protocol=Zero-shot, Calibration Samples=1002025.07 | 52.73 | 76.98 | 88.75 | 83 | 72.25 | 44.4 | 79.71 | 80.87 | 70.4 | 72.12 | |
| FLAPPruning ratio=25%, Base Model=Qwen3-30B-A3B, Evaluation Protocol=Zero-shot, Calibration Samples=1002025.07 | 50.85 | 76.68 | 85.72 | 85 | 69.43 | 42.8 | 77.31 | 81.95 | 70.17 | 71.1 | |
| FLAPPruning ratio=25%, Evaluation Protocol=Zero-shot, Calibration Samples=100 (Zyda2)2025.07 | 50 | 72.85 | 86.91 | 91 | 65.02 | 45.4 | 81.12 | 77.62 | 76.09 | 71.78 | |
| Qwen2-57B-A14BPruning ratio=0%, Evaluation Protocol=Zero-shot, Calibration Samples=100 (Zyda2)2025.07 | 49.66 | 69.44 | 86.45 | 93 | 74.06 | 44.2 | 81.23 | 74.73 | 74.27 | 71.89 | |
| MoNEPruning ratio=25%, Evaluation Protocol=Zero-shot, Calibration Samples=100 (Zyda2)2025.07 | 49.66 | 68.73 | 86.88 | 94 | 71.64 | 45.2 | 81.07 | 75.45 | 73.09 | 71.75 | |
| RSPruning ratio=25%, Evaluation Protocol=Zero-shot, Calibration Samples=100 (Zyda2)2025.07 | 49.15 | 69.78 | 84.77 | 87 | 70.99 | 44.8 | 81.34 | 74.37 | 74.19 | 70.71 | |
| MC-SMoEPruning ratio=25%, Evaluation Protocol=Zero-shot, Calibration Samples=100 (Zyda2)2025.07 | 46.67 | 66.25 | 86.45 | 88 | 69.46 | 43.4 | 80.2 | 74.73 | 75.14 | 70.03 | |
| AngularPruning ratio=25%, Base Model=Qwen3-30B-A3B, Evaluation Protocol=Zero-shot, Calibration Samples=1002025.07 | 44.62 | 68.6 | 80.52 | 77 | 59.75 | 40.4 | 75.3 | 70.4 | 62.51 | 64.34 | |
| AngularPruning ratio=25%, Evaluation Protocol=Zero-shot, Calibration Samples=100 (Zyda2)2025.07 | 29.44 | 54.17 | 59.51 | 70 | 23.92 | 32.8 | 70.02 | 54.87 | 49.57 | 49.37 |