List your company
ResearchFormerly WizWand

Common Sense Reasoning on WinoGrande 2021 (Acc_norm)

78.06Normalized AccuracyBaseline
49.82457.154564.48571.8155Jun 5, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BaselineBackbone=Llama 3.1 8B Instruct, Compression Ratio=1.00x, Zero-shot=true2026.0678.06
SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0673.72
SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0673.32
BaselineBackbone=Qwen3-8B, Compression Ratio=1.00x, Zero-shot=true2026.0670.8
ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0670.64
SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0669.85
SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0667.17
SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.90x, Zero-shot=true2026.0665.98
SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0665.9
SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0665.82
SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0664.09
ASVD+Backbone=Qwen3-8B, Compression Ratio=0.90x, Zero-shot=true2026.0663.3
SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0662.43
SVD-LLMBackbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0662.12
SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0660.85
SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0660.06
SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0659.98
ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.75x, Zero-shot=true2026.0659.27
ASVD+Backbone=Qwen3-8B, Compression Ratio=0.75x, Zero-shot=true2026.0659.19
ASVD+Backbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0655.17
SigmaScaleBackbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0654.85
SigmaScale (KD)Backbone=Qwen3-8B, Compression Ratio=0.50x, Zero-shot=true2026.0654.38
ASVD+Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0651.85
SigmaScale (KD)Backbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0651.78
SVD-LLMBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0651.14
SigmaScaleBackbone=Llama 3.1 8B Instruct, Compression Ratio=0.50x, Zero-shot=true2026.0650.91