Commonsense Reasoning on Hella Swag
79.1AccuracyLlama3 8B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama3 8B2026.02 | 79.1 | |
| COMPOTCR=0.22026.02 | 73.5 | |
| LLM-PrunerCR=0.22026.02 | 67.5 | |
| COMPOTCR=0.32026.02 | 67.2 | |
| ReplaceMeCR=0.222026.02 | 65.7 | |
| COMPOTCR=0.42026.02 | 55.8 | |
| ReplaceMeCR=0.312026.02 | 53.8 | |
| Qwen3-0.6BCompression Ratio=None2026.02 | 47.4 | |
| LLM-PrunerCR=0.32026.02 | 45.1 | |
| ReplaceMeCR=0.412026.02 | 44.3 | |
| COMPOTCompression Ratio=0.22026.02 | 42.6 | |
| COMPOT†Compression Ratio=0.22026.02 | 40.6 | |
| COMPOTCompression Ratio=0.32026.02 | 38.3 | |
| CoSpaDiCompression Ratio=0.22026.02 | 37.5 | |
| COMPOT†Compression Ratio=0.32026.02 | 34.8 | |
| SVD-LLMCompression Ratio=0.22026.02 | 33 | |
| COMPOTCompression Ratio=0.42026.02 | 32.7 | |
| CoSpaDiCompression Ratio=0.32026.02 | 32.3 | |
| COMPOT†Compression Ratio=0.42026.02 | 29.7 | |
| SVD-LLMCompression Ratio=0.32026.02 | 29 | |
| CoSpaDiCompression Ratio=0.42026.02 | 28.2 | |
| SVD-LLMCompression Ratio=0.42026.02 | 26.9 | |
| LLM-PrunerCR=0.42026.02 | 25.8 |