List your company
ResearchFormerly WizWand

Sentence Completion on HellaSwag 2019

80.12Normalized AccuracyBaseline
31.385644.037856.6969.3422Jun 5, 2026
Updated 4mo ago

Evaluation results

MethodLinks
BaselineBackbone=Llama 3.1 8B Instruct, Compression Ratio=1.00x, Zero-shot=true2026.0680.12
BaselineBackbone=Qwen3-8B, Compression Ratio=1.00x, Zero-shot=true2026.0676.49
SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0676.14
SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0675.98
ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0674.35
SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0668.49
SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0668.33
SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0668.09
ASVD+Backbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0665.41
SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0664.71
SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0662.48
SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0661.5
SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0661.41
SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0659.16
SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0658.81
ASVD+Backbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0658.71
ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0656.14
SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0653.84
SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0647.66
ASVD+Backbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0639.49
SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0639.48
SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0639.4
SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0636.3
SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0633.98
SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0633.62
ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0633.26