List your company
ResearchFormerly WizWand

Zero-shot Evaluation on Eight tasks zero-shot

60.31Accuracy (Zero-shot)Dense
34.954841.537448.1254.7026Sep 27, 2025
Updated 6mo ago

Evaluation results

MethodLinks
DenseSparsity=0%, Pattern=-, Backbone Model=LLaMA-3.1 8B2025.0960.31
DenseSparsity=0%, Pattern=-, Backbone Model=LLaMA-2 13B2025.0958.38
PATCHTileSparsity=25%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-3.1 8B2025.0956.48
PATCHTileSparsity=25%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 13B2025.0956.31
PATCHTileSparsity=35%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-3.1 8B2025.0955.28
DenseSparsity=0%, Pattern=-, Backbone Model=LLaMA-2 7B2025.0954.61
PATCHTileSparsity=35%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 13B2025.0954.6
PATCHTileSparsity=45%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-3.1 8B2025.0953.6
PATCHTileSparsity=45%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 13B2025.0953.24
MaskLLMSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.0952.8
PATCHTileSparsity=25%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 7B2025.0951.58
ProxSparseSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.0950.8
PATCHTileSparsity=35%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 7B2025.0950.08
SparseGPTSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.0949.67
ThanosSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.0949.33
PATCHTileSparsity=45%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 7B2025.0948.99
MaskLLMSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.0948.62
WandaSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.0947.95
MagnitudeSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.0945.94
ProxSparseSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.0945.92
ThanosSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.0945.72
SparseGPTSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.0945.53
ProxSparseSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.0945.14
SparseGPTSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.0945.09
ThanosSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.0944.8
WandaSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.0944.3
MagnitudeSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.0943.44
WandaSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.0941.77
MagnitudeSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.0935.93