Common Sense Reasoning on 7 common sense reasoning datasets
71.72Average Performancew/o pruning
Evaluation results
| Method | Links | |
|---|---|---|
| w/o pruningModel=LLaMA2-70B, Pruning Ratio=0%2025.02 | 71.72 | |
| w/o pruningModel=LLaMA3-8B, Pruning Ratio=0%2025.02 | 70.14 | |
| PASERModel=LLaMA3-8B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 69.83 | |
| PASERModel=LLaMA2-70B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 69.62 | |
| Full DataModel=LLaMA3-8B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 67.84 | |
| NuggetsModel=LLaMA2-70B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 67.73 | |
| NuggetsModel=LLaMA3-8B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 67.3 | |
| IFDModel=LLaMA2-70B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 67.27 | |
| w/o pruningModel=Baichuan2-13B, Pruning Ratio=0%2025.02 | 67.25 | |
| Instruction MiningModel=LLaMA2-70B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 66.74 | |
| IFDModel=LLaMA3-8B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 66.64 | |
| RandomModel=LLaMA3-8B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 65.6 | |
| Full DataModel=LLaMA2-70B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 65.56 | |
| Instruction MiningModel=LLaMA3-8B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 65.47 | |
| w/o pruningModel=LLaMA2-13B, Pruning Ratio=0%2025.02 | 64.78 | |
| w/o pruningModel=Baichuan2-7B, Pruning Ratio=0%2025.02 | 64.19 | |
| RandomModel=LLaMA2-70B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 64.03 | |
| PASERModel=Baichuan2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 63.75 | |
| w/o TrainingModel=LLaMA3-8B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 63.45 | |
| PASERDistillation Scheme=SKD, Base Model=LLaMA2-7B2025.02 | 61.94 | |
| Full DataModel=Baichuan2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 61.64 | |
| PASERDistillation Scheme=MiniPLM, Base Model=LLaMA2-7B2025.02 | 61.42 | |
| w/o TrainingModel=LLaMA2-70B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 61.14 | |
| NuggetsModel=Baichuan2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 61.09 | |
| IFDModel=Baichuan2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 60.34 | |
| PASERDistillation Scheme=DistiLLM, Base Model=LLaMA2-7B2025.02 | 60.34 | |
| IFDDistillation Scheme=SKD, Base Model=LLaMA2-7B2025.02 | 59.82 | |
| PASERModel=Baichuan2-7B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 59.7 | |
| Full DataDistillation Scheme=SKD, Base Model=LLaMA2-7B2025.02 | 59.61 | |
| NuggetsDistillation Scheme=SKD, Base Model=LLaMA2-7B2025.02 | 59.5 | |
| IFDDistillation Scheme=MiniPLM, Base Model=LLaMA2-7B2025.02 | 59.39 | |
| Instruction MiningModel=Baichuan2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 59.38 | |
| NuggetsDistillation Scheme=MiniPLM, Base Model=LLaMA2-7B2025.02 | 59.21 | |
| RandomModel=Baichuan2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 59.12 | |
| Instruction MiningDistillation Scheme=SKD, Base Model=LLaMA2-7B2025.02 | 58.79 | |
| IFDDistillation Scheme=DistiLLM, Base Model=LLaMA2-7B2025.02 | 58.55 | |
| NuggetsDistillation Scheme=DistiLLM, Base Model=LLaMA2-7B2025.02 | 58.42 | |
| Full DataDistillation Scheme=MiniPLM, Base Model=LLaMA2-7B2025.02 | 58.21 | |
| NuggetsModel=Baichuan2-7B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 57.84 | |
| Instruction MiningDistillation Scheme=DistiLLM, Base Model=LLaMA2-7B2025.02 | 57.71 | |
| PASERModel=LLaMA2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 57.62 | |
| w/o TrainingModel=Baichuan2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 57.59 | |
| Instruction MiningDistillation Scheme=MiniPLM, Base Model=LLaMA2-7B2025.02 | 57.5 | |
| Full DataModel=Baichuan2-7B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 57.39 | |
| RandomDistillation Scheme=SKD, Base Model=LLaMA2-7B2025.02 | 57.38 | |
| IFDModel=Baichuan2-7B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 57.36 | |
| Full DataDistillation Scheme=DistiLLM, Base Model=LLaMA2-7B2025.02 | 57.12 | |
| RandomModel=Baichuan2-7B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 57.09 | |
| w/o TrainingDistillation Scheme=SKD, Base Model=LLaMA2-7B2025.02 | 56.67 | |
| w/o TrainingDistillation Scheme=MiniPLM, Base Model=LLaMA2-7B2025.02 | 56.43 | |
| Full DataModel=LLaMA2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 56.4 | |
| w/o TrainingModel=Baichuan2-7B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 56.33 | |
| RandomDistillation Scheme=DistiLLM, Base Model=LLaMA2-7B2025.02 | 56.29 | |
| RandomDistillation Scheme=MiniPLM, Base Model=LLaMA2-7B2025.02 | 56.07 | |
| NuggetsModel=LLaMA2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 55.25 | |
| w/o TrainingDistillation Scheme=DistiLLM, Base Model=LLaMA2-7B2025.02 | 55.2 | |
| Instruction MiningModel=Baichuan2-7B, Pruning Ratio=25%, Pruning Scheme=LLM-Pruner2025.02 | 54.78 | |
| IFDModel=LLaMA2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 54.77 | |
| RandomModel=LLaMA2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 54.62 | |
| Instruction MiningModel=LLaMA2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 54.09 | |
| w/o TrainingModel=LLaMA2-13B, Pruning Ratio=50%, Pruning Scheme=LLM-Pruner2025.02 | 48.86 |