List your company
ResearchFormerly WizWand

Zero-shot Evaluation on ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, RTE, and WinoGrande

72.9AccuracyDense
34.62844.56454.564.436Apr 6, 2026
Updated 7mo ago

Evaluation results

MethodLinks
DenseSparsity(CR)=0%, Backbone=Llama-3 8B2026.0472.9
SLaBSparsity(CR)=US (50%), Backbone=Llama-3 8B2026.0470.7
SLaBSparsity(CR)=4:8 (50%), Backbone=Llama-3 8B2026.0470.1
SLaBSparsity(CR)=2:4 (50%), Backbone=Llama-3 8B2026.0470.1
SLaBSparsity(CR)=US (60%), Backbone=Llama-3 8B2026.0469.2
DenseSparsity(CR)=0%, Backbone=Llama-2 7B2026.0468.4
SparseGPTSparsity(CR)=US (50%), Backbone=Llama-3 8B2026.0466.9
SLaBSparsity(CR)=US (50%), Backbone=Llama-2 7B2026.0466.2
WandaSparsity(CR)=US (50%), Backbone=Llama-3 8B2026.0465.4
WandaSparsity(CR)=4:8 (50%), Backbone=Llama-3 8B2026.0465.4
SLaBSparsity(CR)=4:8 (50%), Backbone=Llama-2 7B2026.0465.3
SLaBSparsity(CR)=2:4 (50%), Backbone=Llama-2 7B2026.0465.3
SLaBSparsity(CR)=US (60%), Backbone=Llama-2 7B2026.0465
SLaBSparsity(CR)=US (70%), Backbone=Llama-3 8B2026.0464.3
WandaSparsity(CR)=US (50%), Backbone=Llama-2 7B2026.0464
SparseGPTSparsity(CR)=US (50%), Backbone=Llama-2 7B2026.0463.9
SLaBSparsity(CR)=US (70%), Backbone=Llama-2 7B2026.0462.2
SparseGPTSparsity(CR)=4:8 (50%), Backbone=Llama-2 7B2026.0461.6
SparseGPTSparsity(CR)=4:8 (50%), Backbone=Llama-3 8B2026.0461.3
WandaSparsity(CR)=4:8 (50%), Backbone=Llama-2 7B2026.0460.8
SparseGPTSparsity(CR)=US (60%), Backbone=Llama-3 8B2026.0459
SparseGPTSparsity(CR)=2:4 (50%), Backbone=Llama-2 7B2026.0458.9
SparseGPTSparsity(CR)=US (60%), Backbone=Llama-2 7B2026.0458.7
DenseSparsity(CR)=0%, Backbone=Llama-3.2 1B2026.0458.3
SparseGPTSparsity(CR)=2:4 (50%), Backbone=Llama-3 8B2026.0457.4
WandaSparsity(CR)=US (60%), Backbone=Llama-2 7B2026.0457.1
SLaBSparsity(CR)=US (50%), Backbone=Llama-3.2 1B2026.0455.8
WandaSparsity(CR)=2:4 (50%), Backbone=Llama-2 7B2026.0455.6
SLaBSparsity(CR)=US (80%), Backbone=Llama-2 7B2026.0453.4
WandaSparsity(CR)=US (60%), Backbone=Llama-3 8B2026.0453.3
SLaBSparsity(CR)=4:8 (50%), Backbone=Llama-3.2 1B2026.0452.5
SLaBSparsity(CR)=2:4 (50%), Backbone=Llama-3.2 1B2026.0452.5
WandaSparsity(CR)=2:4 (50%), Backbone=Llama-3 8B2026.0452.2
SLaBSparsity(CR)=US (60%), Backbone=Llama-3.2 1B2026.0451.7
SparseGPTSparsity(CR)=US (50%), Backbone=Llama-3.2 1B2026.0451.2
SLaBSparsity(CR)=US (80%), Backbone=Llama-3 8B2026.0449.3
WandaSparsity(CR)=US (50%), Backbone=Llama-3.2 1B2026.0448.5
SparseGPTSparsity(CR)=4:8 (50%), Backbone=Llama-3.2 1B2026.0448
SparseGPTSparsity(CR)=US (70%), Backbone=Llama-2 7B2026.0447.6
SparseGPTSparsity(CR)=US (70%), Backbone=Llama-3 8B2026.0446.9
SLaBSparsity(CR)=US (70%), Backbone=Llama-3.2 1B2026.0446.6
SparseGPTSparsity(CR)=2:4 (50%), Backbone=Llama-3.2 1B2026.0446.5
SparseGPTSparsity(CR)=US (60%), Backbone=Llama-3.2 1B2026.0445.2
WandaSparsity(CR)=4:8 (50%), Backbone=Llama-3.2 1B2026.0444.3
WandaSparsity(CR)=US (60%), Backbone=Llama-3.2 1B2026.0441.5
SLaBSparsity(CR)=US (80%), Backbone=Llama-3.2 1B2026.0441.5
WandaSparsity(CR)=2:4 (50%), Backbone=Llama-3.2 1B2026.0441.3
SparseGPTSparsity(CR)=US (70%), Backbone=Llama-3.2 1B2026.0440.8
WandaSparsity(CR)=US (70%), Backbone=Llama-2 7B2026.0439.9
SparseGPTSparsity(CR)=US (80%), Backbone=Llama-3 8B2026.0439.5
WandaSparsity(CR)=US (70%), Backbone=Llama-3 8B2026.0439.3
SparseGPTSparsity(CR)=US (80%), Backbone=Llama-3.2 1B2026.0438.5
SparseGPTSparsity(CR)=US (80%), Backbone=Llama-2 7B2026.0437.6
WandaSparsity(CR)=US (70%), Backbone=Llama-3.2 1B2026.0437.4
WandaSparsity(CR)=US (80%), Backbone=Llama-3 8B2026.0437.2
WandaSparsity(CR)=US (80%), Backbone=Llama-3.2 1B2026.0436.6
WandaSparsity(CR)=US (80%), Backbone=Llama-2 7B2026.0436.1