Commonsense Reasoning on PIQA (Accuracy and Average Accuracy)
60.66AccuracyGRASPrune
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRASPruneModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 60.66 | 44.12 | |
| FLAPModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 59.47 | 43.44 | |
| GRASPruneModel=LLaMA-7B, Parameter Retention=40%2026.04 | 57.34 | 40.74 | |
| GRASPruneModel=Vicuna-7B, Parameter Retention=40%2026.04 | 57.34 | 41.61 | |
| LLM-PrunerModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 56.91 | 38.81 | |
| GRASPruneModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 56.64 | 40.6 | |
| FLAPModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 56.42 | 39.64 | |
| FLAPModel=LLaMA-7B, Parameter Retention=40%2026.04 | 55.22 | 38.25 | |
| FLAPModel=Vicuna-7B, Parameter Retention=40%2026.04 | 55.06 | 38.99 | |
| LLM-PrunerModel=Vicuna-7B, Parameter Retention=40%2026.04 | 54.95 | 38.29 | |
| LLM-PrunerModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 53.65 | 36.54 | |
| LLM-PrunerModel=LLaMA-7B, Parameter Retention=40%2026.04 | 53.26 | 37.58 | |
| SliceGPTModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 52.18 | 37.25 | |
| SliceGPTModel=Vicuna-7B, Parameter Retention=40%2026.04 | 51.63 | 36.88 | |
| SliceGPTModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 51.36 | 36.52 | |
| SliceGPTModel=LLaMA-7B, Parameter Retention=40%2026.04 | 50.71 | 35.28 |