List your company
ResearchFormerly WizWand

Zero-shot Question Answering on ARC-E

79.38Zero-shot AccuracyDense
22.689637.407352.12566.8427Oct 2, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DenseSparsity=0%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1079.38
WandaSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1076.3
ALPSSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1076.3
L-ADMMSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1075.84
SAFESparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1075.84
ELSASparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1075.12
SparseGPTSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1074.96
L-ADMMSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1072.98
ALPSSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1072.93
SAFESparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1072.43
ELSASparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1070.67
MagnitudeSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1070.58
SparseGPTSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1069.4
WandaSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1068.81
ELSASparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1062.42
ALPSSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1061.2
SAFESparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1061.07
L-ADMMSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1059.64
MagnitudeSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1056.14
ELSASparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1050.97
SparseGPTSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1049.58
WandaSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1036.45
ELSASparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1036.15
ALPSSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1035.99
L-ADMMSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1033.8
MagnitudeSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1031.31
SparseGPTSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1028.79
SAFESparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1028.37
ALPSSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1026.94
WandaSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1026.26
L-ADMMSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1026.01
WandaSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1025.93
SparseGPTSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1025.76
SAFESparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1025.76
MagnitudeSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1025.63
MagnitudeSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1024.87