List your company
ResearchFormerly WizWand

Question Answering on OBQA (acc_norm)

41.8Accuracy (Normalized)No pruning (Original)
21.62426.86232.137.338Nov 19, 2025Dec 10, 2025Dec 31, 2025Jan 21, 2026Feb 11, 2026Mar 4, 2026Mar 25, 2026
Updated 5mo ago

Evaluation results

MethodLinks
No pruning (Original)Backbone=Gemma-2 2B, Sparsity=0, Evaluation Protocol=Zero-shot2026.0341.8
WandaBackbone=LLaMA-1, Model Parameters=65B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot, Quantization=8-bit2025.1138.8
AutoPruneBackbone=LLaMA-1, Model Parameters=65B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot, Quantization=8-bit2025.1138.8
DenseBackbone=LLaMA-1, Model Parameters=65B, Sparsity=0%, Evaluation Protocol=zero-shot, Quantization=8-bit2025.1138.2
SparseGPTBackbone=LLaMA-1, Model Parameters=65B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot, Quantization=8-bit2025.1137.2
DenseBackbone=LLaMA-1, Model Parameters=30B, Sparsity=0%, Evaluation Protocol=zero-shot2025.1136
DIETBackbone=Gemma-2 2B, Sparsity=10%, Evaluation Protocol=Zero-shot2026.0335.4
AutoPruneBackbone=LLaMA-1, Model Parameters=30B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1135.2
SparseGPTBackbone=LLaMA-1, Model Parameters=30B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1135
MagnitudeBackbone=LLaMA-1, Model Parameters=65B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot, Quantization=8-bit2025.1135
WandaBackbone=LLaMA-1, Model Parameters=30B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1134.6
DenseBackbone=LLaMA-1, Model Parameters=7B, Sparsity=0%, Evaluation Protocol=zero-shot2025.1134.4
DenseBackbone=LLaMA-1, Model Parameters=13B, Sparsity=0%, Evaluation Protocol=zero-shot2025.1133.2
WandaBackbone=LLaMA-1, Model Parameters=13B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1132.2
AutoPruneBackbone=LLaMA-1, Model Parameters=13B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1132.2
Magnitude-DimBackbone=Gemma-2 2B, Sparsity=10%, Evaluation Protocol=Zero-shot2026.0331.2
SparseGPTBackbone=LLaMA-1, Model Parameters=13B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1131.2
PuDDingBackbone=Gemma-2 2B, Sparsity=10%, Evaluation Protocol=Zero-shot2026.0330
SparseGPTBackbone=LLaMA-1, Model Parameters=7B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1130
AutoPruneBackbone=LLaMA-1, Model Parameters=7B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1130
MagnitudeBackbone=LLaMA-1, Model Parameters=30B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1129
WandaBackbone=LLaMA-1, Model Parameters=7B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1128.8
DIETBackbone=Gemma-2 2B, Sparsity=20%, Evaluation Protocol=Zero-shot2026.0327.6
MagnitudeBackbone=LLaMA-1, Model Parameters=13B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1127.2
SliceGPTBackbone=Gemma-2 2B, Sparsity=20%, Evaluation Protocol=Zero-shot2026.0327
PuDDingBackbone=Gemma-2 2B, Sparsity=20%, Evaluation Protocol=Zero-shot2026.0327
SliceGPTBackbone=Gemma-2 2B, Sparsity=10%, Evaluation Protocol=Zero-shot2026.0327
Magnitude-DimBackbone=Gemma-2 2B, Sparsity=20%, Evaluation Protocol=Zero-shot2026.0325
MagnitudeBackbone=LLaMA-1, Model Parameters=7B, Sparsity=50% unstructured, Evaluation Protocol=zero-shot2025.1122.4