List your company
ResearchFormerly WizWand

Question Answering on ARC Challenge (Zero-shot)

48.46Zero-shot AccuracyDense
17.135225.267633.441.5324Oct 2, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DenseSparsity=0%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1048.46
ELSASparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1043.68
L-ADMMSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1043.17
WandaSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1043.09
ALPSSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1042.66
SparseGPTSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1042.41
SAFESparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1041.64
ELSASparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1040.53
ALPSSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1040.44
L-ADMMSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1039.76
MagnitudeSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1038.48
WandaSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1037.97
SAFESparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1036.95
SparseGPTSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1036.01
ELSASparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1034.13
SAFESparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1029.78
ALPSSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1029.61
L-ADMMSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1027.56
MagnitudeSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1027.13
SparseGPTSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1025.34
ELSASparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1024.32
SAFESparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1022.1
MagnitudeSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1021.84
MagnitudeSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1021.42
WandaSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1021.33
SparseGPTSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1021.08
MagnitudeSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1020.65
WandaSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1020.48
ALPSSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1020.05
L-ADMMSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1019.88
SparseGPTSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1019.62
L-ADMMSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1019.11
ELSASparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1019.03
ALPSSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1018.94
WandaSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1018.43
SAFESparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.1018.34