Language Understanding on MMLU (Domain Scores: Humanities, Social, STEM, Other)
46.21Humanities ScoreToken Filtering
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Token FilteringPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 46.21 | 62.82 | 45.32 | 61.64 | 53.06 | |
| DensePruning Ratio=0%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 39.21 | 45.99 | 33.17 | 45.41 | 40.81 | |
| FLAPPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 30.09 | 29.57 | 27.05 | 32.63 | 29.86 | |
| FLAPPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 24.35 | 21.7 | 22.23 | 23.94 | 23.2 | |
| Token FilteringPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 24.27 | 22.23 | 22.01 | 23.85 | 23.22 | |
| SlimGPT w/oPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 24.14 | 21.32 | 21.5 | 23.72 | 22.84 | |
| SlimGPT w/oPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 21.55 | 20.51 | 20.55 | 21.93 | 21.22 |