List your company
ResearchFormerly WizWand

Zero-shot Evaluation on Mean tasks zero-shot (test)

68.36Mean Zero-Shot AccuracyDense
39.18846.761554.33561.9085May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DenseModel=Qwen3-14B, Sparsity=None2026.0568.36
DenseModel=Qwen3-8B, Sparsity=None2026.0565.73
SparseForgeModel=Qwen3-14B, Sparsity=2:4 semi-structured2026.0565.44
SparseForgeModel=Qwen3-8B, Sparsity=2:4 semi-structured2026.0563.31
DenseModel=DeepSeek-MoE, Sparsity=None2026.0559.54
SparseForgeModel=DeepSeek-MoE, Sparsity=2:4 semi-structured2026.0558.57
DenseModel=Qwen3-1.7B, Sparsity=None2026.0556.51
SparseForgeModel=Qwen3-1.7B, Sparsity=2:4 semi-structured2026.0553.33
DenseModel=OPT-2.7B, Sparsity=None2026.0547.76
SparseForgeModel=OPT-2.7B, Sparsity=2:4 semi-structured2026.0546.67
DenseModel=GPT2-XL, Sparsity=None2026.0545.49
SparseForgeModel=GPT2-XL, Sparsity=2:4 semi-structured2026.0544.34
DenseModel=GPT2-L, Sparsity=None2026.0542.76
SparseForgeModel=GPT2-L, Sparsity=2:4 semi-structured2026.0542.1
DenseModel=GPT2-M, Sparsity=None2026.0540.97
SparseForgeModel=GPT2-M, Sparsity=2:4 semi-structured2026.0540.31