Commonsense Reasoning on CMQA (Accuracy %)
70.47CMQA Accuracy (%)Dense
Evaluation results
| Method | Links | |
|---|---|---|
| DensePruning Ratio=0%, Backbone=Mistral-0.3 7B2025.10 | 70.47 | |
| DensePruning Ratio=0%, Backbone=Llama3 8B2025.10 | 69.99 | |
| DensePruning Ratio=0%, Backbone=Llama2-13B2025.10 | 69.19 | |
| GISPPruning Ratio=20%, Backbone=Llama2-13B2025.10 | 67.61 | |
| OWLPruning Ratio=20%, Backbone=Llama2-13B2025.10 | 66.98 | |
| DensePruning Ratio=0%, Backbone=Llama2-7B2025.10 | 66.68 | |
| GISPPruning Ratio=20%, Backbone=Mistral-0.3 7B2025.10 | 66.6 | |
| Wanda-spPruning Ratio=20%, Backbone=Llama2-13B2025.10 | 66.3 | |
| GISPPruning Ratio=30%, Backbone=Llama2-13B2025.10 | 66.12 | |
| OWLPruning Ratio=20%, Backbone=Mistral-0.3 7B2025.10 | 65.87 | |
| GISPPruning Ratio=20%, Backbone=Llama3 8B2025.10 | 65.28 | |
| FLAPPruning Ratio=20%, Backbone=Llama2-13B2025.10 | 65 | |
| Wanda-spPruning Ratio=20%, Backbone=Mistral-0.3 7B2025.10 | 64.39 | |
| GISPPruning Ratio=30%, Backbone=Mistral-0.3 7B2025.10 | 63.48 | |
| GISPPruning Ratio=20%, Backbone=Llama2-7B2025.10 | 63.46 | |
| GISPPruning Ratio=40%, Backbone=Llama2-13B2025.10 | 63.34 | |
| FLAPPruning Ratio=30%, Backbone=Llama2-13B2025.10 | 63.28 | |
| OWLPruning Ratio=30%, Backbone=Llama2-13B2025.10 | 63.27 | |
| Wanda-spPruning Ratio=30%, Backbone=Llama2-13B2025.10 | 62.69 | |
| OWLPruning Ratio=20%, Backbone=Llama2-7B2025.10 | 62.64 | |
| Wanda-spPruning Ratio=20%, Backbone=Llama2-7B2025.10 | 61.77 | |
| FLAPPruning Ratio=20%, Backbone=Llama2-7B2025.10 | 61.27 | |
| ShortGPTPruning Ratio=20%, Backbone=Llama2-13B2025.10 | 60.84 | |
| OWLPruning Ratio=40%, Backbone=Llama2-13B2025.10 | 60.84 | |
| GISPPruning Ratio=30%, Backbone=Llama2-7B2025.10 | 60.68 | |
| OWLPruning Ratio=20%, Backbone=Llama3 8B2025.10 | 59.95 | |
| FLAPPruning Ratio=40%, Backbone=Llama2-13B2025.10 | 59.89 | |
| GISPPruning Ratio=30%, Backbone=Llama3 8B2025.10 | 59.66 | |
| Wanda-spPruning Ratio=40%, Backbone=Llama2-13B2025.10 | 59.11 | |
| OWLPruning Ratio=30%, Backbone=Mistral-0.3 7B2025.10 | 58.54 | |
| OWLPruning Ratio=30%, Backbone=Llama2-7B2025.10 | 58.33 | |
| GISPPruning Ratio=40%, Backbone=Mistral-0.3 7B2025.10 | 58.3 | |
| Wanda-spPruning Ratio=30%, Backbone=Mistral-0.3 7B2025.10 | 58.24 | |
| ShortGPTPruning Ratio=20%, Backbone=Mistral-0.3 7B2025.10 | 57.75 | |
| ShortGPTPruning Ratio=20%, Backbone=Llama3 8B2025.10 | 57.68 | |
| GISPPruning Ratio=50%, Backbone=Llama2-13B2025.10 | 57.5 | |
| Wanda-spPruning Ratio=20%, Backbone=Llama3 8B2025.10 | 57.45 | |
| LLM-PrunerPruning Ratio=20%, Backbone=Llama2-13B2025.10 | 57.3 | |
| Wanda-spPruning Ratio=30%, Backbone=Llama2-7B2025.10 | 57.14 | |
| FLAPPruning Ratio=30%, Backbone=Llama2-7B2025.10 | 56.9 | |
| ShortGPTPruning Ratio=30%, Backbone=Llama2-13B2025.10 | 56.86 | |
| LLM-PrunerPruning Ratio=20%, Backbone=Llama3 8B2025.10 | 56.51 | |
| FLAPPruning Ratio=50%, Backbone=Llama2-13B2025.10 | 56.29 | |
| ShortGPTPruning Ratio=20%, Backbone=Llama2-7B2025.10 | 55.75 | |
| GISPPruning Ratio=40%, Backbone=Llama2-7B2025.10 | 55.28 | |
| OWLPruning Ratio=40%, Backbone=Mistral-0.3 7B2025.10 | 54.36 | |
| OWLPruning Ratio=50%, Backbone=Llama2-13B2025.10 | 54.17 | |
| GISPPruning Ratio=40%, Backbone=Llama3 8B2025.10 | 53.51 | |
| FLAPPruning Ratio=40%, Backbone=Llama2-7B2025.10 | 53.01 | |
| OWLPruning Ratio=30%, Backbone=Llama3 8B2025.10 | 52.24 | |
| Wanda-spPruning Ratio=30%, Backbone=Llama3 8B2025.10 | 52.03 | |
| Wanda-spPruning Ratio=40%, Backbone=Mistral-0.3 7B2025.10 | 51.89 | |
| Wanda-spPruning Ratio=50%, Backbone=Llama2-13B2025.10 | 51.6 | |
| OWLPruning Ratio=40%, Backbone=Llama2-7B2025.10 | 51.5 | |
| LLM-PrunerPruning Ratio=20%, Backbone=Llama2-7B2025.10 | 50.95 | |
| Wanda-spPruning Ratio=40%, Backbone=Llama2-7B2025.10 | 50.12 | |
| ShortGPTPruning Ratio=30%, Backbone=Llama2-7B2025.10 | 50.01 | |
| GISPPruning Ratio=50%, Backbone=Mistral-0.3 7B2025.10 | 49.79 | |
| ShortGPTPruning Ratio=40%, Backbone=Llama2-13B2025.10 | 48.73 | |
| GISPPruning Ratio=50%, Backbone=Llama2-7B2025.10 | 48.54 | |
| FLAPPruning Ratio=50%, Backbone=Llama2-7B2025.10 | 47.84 | |
| LLM-PrunerPruning Ratio=30%, Backbone=Llama3 8B2025.10 | 47.46 | |
| LLM-PrunerPruning Ratio=30%, Backbone=Llama2-13B2025.10 | 46.26 | |
| OWLPruning Ratio=50%, Backbone=Mistral-0.3 7B2025.10 | 46.09 | |
| GISPPruning Ratio=50%, Backbone=Llama3 8B2025.10 | 45.68 | |
| ShortGPTPruning Ratio=40%, Backbone=Llama2-7B2025.10 | 45.35 | |
| OWLPruning Ratio=40%, Backbone=Llama3 8B2025.10 | 44.87 | |
| OWLPruning Ratio=50%, Backbone=Llama2-7B2025.10 | 44.82 | |
| Wanda-spPruning Ratio=50%, Backbone=Mistral-0.3 7B2025.10 | 44.38 | |
| Wanda-spPruning Ratio=40%, Backbone=Llama3 8B2025.10 | 43.61 | |
| ShortGPTPruning Ratio=30%, Backbone=Llama3 8B2025.10 | 43.53 | |
| Wanda-spPruning Ratio=50%, Backbone=Llama2-7B2025.10 | 43.52 | |
| ShortGPTPruning Ratio=40%, Backbone=Llama3 8B2025.10 | 43.37 | |
| LLM-PrunerPruning Ratio=40%, Backbone=Llama2-13B2025.10 | 41.99 | |
| OWLPruning Ratio=50%, Backbone=Llama3 8B2025.10 | 41.86 | |
| LLM-PrunerPruning Ratio=40%, Backbone=Llama3 8B2025.10 | 41.82 | |
| ShortGPTPruning Ratio=50%, Backbone=Llama2-7B2025.10 | 41.75 | |
| ShortGPTPruning Ratio=50%, Backbone=Llama2-13B2025.10 | 41.75 | |
| LLM-PrunerPruning Ratio=30%, Backbone=Llama2-7B2025.10 | 41.37 | |
| Wanda-spPruning Ratio=50%, Backbone=Llama3 8B2025.10 | 41.32 | |
| ShortGPTPruning Ratio=50%, Backbone=Llama3 8B2025.10 | 41.19 | |
| ShortGPTPruning Ratio=30%, Backbone=Mistral-0.3 7B2025.10 | 41.1 | |
| LLM-PrunerPruning Ratio=50%, Backbone=Llama2-13B2025.10 | 40.92 | |
| ShortGPTPruning Ratio=40%, Backbone=Mistral-0.3 7B2025.10 | 39.68 | |
| LLM-PrunerPruning Ratio=50%, Backbone=Llama3 8B2025.10 | 39.67 | |
| LLM-PrunerPruning Ratio=40%, Backbone=Llama2-7B2025.10 | 39.13 | |
| ShortGPTPruning Ratio=50%, Backbone=Mistral-0.3 7B2025.10 | 38.73 | |
| LLM-PrunerPruning Ratio=50%, Backbone=Llama2-7B2025.10 | 38.62 |