Language Understanding on Winogrande, BoolQ, OpenBookQA, SciQ, Race, and PIQA (test)
72.8Avg AccBaseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BaselineModel=Llama-3-70B-Instruct, Compression Ratio=0%2025.05 | 72.8 | 1 | |
| BaselineModel=Llama-3.1-8B-Instruct, Compression Ratio=0%2025.05 | 71.18 | 1 | |
| ReplaceMeModel=Llama-3-70B-Instruct, Compression Ratio=25%2025.05 | 70.36 | 0.9664 | |
| ReplaceMeModel=Llama-3-70B-Instruct, Compression Ratio=37.5%2025.05 | 65.96 | 0.906 | |
| ReplaceMeModel=Llama-3.1-8B-Instruct, Compression Ratio=25%2025.05 | 65.37 | 0.9184 | |
| BaselineModel=Llama-3.2-1B-Instruct, Compression Ratio=0%2025.05 | 60.98 | 1 | |
| ReplaceMeModel=Llama-3.2-1B-Instruct, Compression Ratio=25%2025.05 | 53.48 | 0.8771 |