Total Retention on LLaMA-3.1-8B Capability Evaluation Suite
97.9Total Retention (S_m^total)mix_balanced
Evaluation results
| Method | Links | |
|---|---|---|
| mix_balancedCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 97.9 | |
| MetaMathCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 97.83 | |
| mix_4_3_3_mathCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 96.86 | |
| mix_4_3_3_codeCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 95.8 | |
| GSM8KCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 95.67 | |
| IGSP –NO-DIVERSITYCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 95.4 | |
| IGSP (full)Calibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 95.2 | |
| IGSP –NO-BANDCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 94.85 | |
| Self-CalCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 94.5 | |
| SGSCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 94.3 | |
| IGSP –NO-MULTICalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 93.9 | |
| WikipediaCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 93.49 | |
| C4 (default)Calibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=30%2026.06 | 93.28 | |
| mix_balancedCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 91.34 | |
| MetaMathCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 90.3 | |
| mix_4_3_3_mathCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 89.32 | |
| mix_4_3_3_codeCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 87.31 | |
| GSM8KCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 87.08 | |
| IGSP –NO-DIVERSITYCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 86.2 | |
| IGSP (full)Calibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 86 | |
| IGSP –NO-BANDCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 85.2 | |
| Self-CalCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 84.5 | |
| SGSCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 84.1 | |
| IGSP –NO-MULTICalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 83.2 | |
| WikipediaCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 82.84 | |
| C4 (default)Calibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=40%2026.06 | 81.72 | |
| mix_balancedCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 79.25 | |
| mix_4_3_3_mathCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 76.22 | |
| MetaMathCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 75.12 | |
| mix_4_3_3_codeCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 73.48 | |
| GSM8KCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 71.45 | |
| IGSP –NO-DIVERSITYCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 70.43 | |
| IGSP (full)Calibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 69.32 | |
| IGSP –NO-BANDCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 68.7 | |
| SGSCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 67.18 | |
| Self-CalCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 66.75 | |
| IGSP –NO-MULTICalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 65.81 | |
| WikipediaCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 63.59 | |
| C4 (default)Calibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=50%2026.06 | 62.08 | |
| mix_balancedCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 58.78 | |
| mix_4_3_3_codeCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 55.9 | |
| mix_4_3_3_mathCalibration Track=Multi-source, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 53.46 | |
| MetaMathCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 50.02 | |
| IGSP (full)Calibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 49.08 | |
| GSM8KCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 48.88 | |
| IGSP –NO-DIVERSITYCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 48.03 | |
| IGSP –NO-BANDCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 47.04 | |
| Self-CalCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 46.67 | |
| SGSCalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 44.29 | |
| IGSP –NO-MULTICalibration Track=Self-generation track, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 44.04 | |
| WikipediaCalibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 41.01 | |
| C4 (default)Calibration Track=Single-source, Pruning Algorithm=SparseGPT, Sparsity=60%2026.06 | 39.99 |