List your company
ResearchFormerly WizWand

Question Answering on OBQA (Zero-shot)

35.2Zero-shot AccuracyDense
11.69617.79823.930.002Oct 2, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DenseSparsity=0%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1035.2
ELSASparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1033.8
ALPSSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1032.6
L-ADMMSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1032
WandaSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1031.2
SparseGPTSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1031
ELSASparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1031
ALPSSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1030.8
SAFESparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1030.6
L-ADMMSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1029.8
SAFESparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1028.8
WandaSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1028.2
MagnitudeSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1027.8
SparseGPTSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1027.4
ALPSSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1026.6
ELSASparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1024.8
L-ADMMSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1024
MagnitudeSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1021.8
SparseGPTSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1020.2
SAFESparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1020.2
ELSASparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1019.6
ELSASparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1016.2
MagnitudeSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1015
MagnitudeSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1014.8
MagnitudeSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1014.6
L-ADMMSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1014.6
SAFESparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1014.2
ALPSSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1014
WandaSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1013.8
SparseGPTSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1013.8
L-ADMMSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1013.8
ALPSSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1013.4
WandaSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1013
SparseGPTSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1012.8
SAFESparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1012.8
WandaSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1012.6