Sentence Completion on HellaSwag 2019
80.12Normalized AccuracyBaseline
Evaluation Results
| Method | Links | |
|---|---|---|
| BaselineBackbone=Llama 3.1 8B Instruct, Compression Ratio=1.00x, Zero-shot=true2026.06 | 80.12 | |
| BaselineBackbone=Qwen3-8B, Compression Ratio=1.00x, Zero-shot=true2026.06 | 76.49 | |
| SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.06 | 76.14 | |
| SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.06 | 75.98 | |
| ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.06 | 74.35 | |
| SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.06 | 68.49 | |
| SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.06 | 68.33 | |
| SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.06 | 68.09 | |
| ASVD+Backbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.06 | 65.41 | |
| SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.06 | 64.71 | |
| SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.06 | 62.48 | |
| SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.06 | 61.5 | |
| SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.06 | 61.41 | |
| SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.06 | 59.16 | |
| SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.06 | 58.81 | |
| ASVD+Backbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.06 | 58.71 | |
| ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.06 | 56.14 | |
| SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.06 | 53.84 | |
| SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.06 | 47.66 | |
| ASVD+Backbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.06 | 39.49 | |
| SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.06 | 39.48 | |
| SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.06 | 39.4 | |
| SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.06 | 36.3 | |
| SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.06 | 33.98 | |
| SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.06 | 33.62 | |
| ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.06 | 33.26 |