List your company
ResearchFormerly WizWand

Zero-shot Evaluation on 7 tasks zero-shot

72.79Mean Accuracy (Zero-shot)BTC-LLM
51.033256.681662.3367.9784May 24, 2025Jul 29, 2025Oct 3, 2025Dec 8, 2025Feb 12, 2026Apr 19, 2026Jun 24, 2026
Updated 4mo ago

Evaluation results

MethodLinks
BTC-LLMBackbone=Qwen2.5-14b, Bits=1.11bit2025.0572.79—
FP16Backbone=Qwen3-14b2025.0572.71—
FP16Backbone=Qwen2.5-14b2025.0572.25—
BTC-LLMBackbone=Qwen2.5-14b, Bits=0.9bit2025.0571.5—
FP16Backbone=Qwen3-8b2025.0569.47—
DenseModel=LLaMA3-8B, Sparsity=Dense2026.0668.23—
SparseGPTModel=LLaMA3-8B, Criterion=S-S, Sparsity=30%2026.0667.78—
BTC-LLMBackbone=Qwen2.5-14b, Bits=0.8bit2025.0567.73—
EPTSModel=LLaMA3-8B, Criterion=M-S, Sparsity=30%2026.0667.11—
WandaModel=LLaMA3-8B, Criterion=S-S, Sparsity=30%2026.0667.1—
RIAModel=LLaMA3-8B, Criterion=S-S, Sparsity=30%2026.0667.06—
BTC-LLMBackbone=Qwen3-14b, Bits=1.11bit2025.0566.53—
SparseGPTModel=LLaMA3-8B, Criterion=S-S, Sparsity=40%2026.0666.01—
DenseArchitecture=Qwen3-8B, Sparsity=0%2026.0665.74—
BTC-LLMBackbone=Qwen3-8b, Bits=0.9bit2025.0565.53—
BTC-LLMBackbone=Qwen3-8b, Bits=1.11bit2025.0565.45—
EPTSModel=LLaMA3-8B, Criterion=M-S, Sparsity=40%2026.0665.38—
FP16Backbone=Qwen2.5-3b2025.0565.24—
WandaModel=LLaMA3-8B, Criterion=S-S, Sparsity=40%2026.0665—
RIAModel=LLaMA3-8B, Criterion=S-S, Sparsity=40%2026.0664.87—
DenseArchitecture=Mistral-7B, Sparsity=0%2026.0664.37—
DenseModel=LLaMA-7B, Sparsity=Dense2026.0664.24—
DenseModel=LLaMA2-7B, Sparsity=Dense2026.0664.21—
RIAModel=LLaMA-7B, Criterion=S-S, Sparsity=30%2026.0663.6—
SparseGPTModel=LLaMA-7B, Criterion=S-S, Sparsity=30%2026.0663.55—
WandaModel=LLaMA2-7B, Criterion=S-S, Sparsity=30%2026.0663.45—
RIAModel=LLaMA2-7B, Criterion=S-S, Sparsity=30%2026.0663.42—
EPTSModel=LLaMA2-7B, Criterion=M-S, Sparsity=30%2026.0663.37—
EPTSModel=LLaMA-7B, Criterion=M-S, Sparsity=30%2026.0663.33—
WandaModel=LLaMA-7B, Criterion=S-S, Sparsity=30%2026.0663.14—
SparseGPTModel=LLaMA2-7B, Criterion=S-S, Sparsity=30%2026.0663.12—
DenseArchitecture=LLaMA-2-13B, Sparsity=0%2026.0663.05—
SparseGPTModel=LLaMA3-8B, Criterion=S-S, Sparsity=50%2026.0663.02—
BTC-LLMBackbone=Qwen2.5-3b, Bits=1.11bit2025.0562.77—
WandaModel=LLaMA2-7B, Criterion=S-S, Sparsity=40%2026.0662.69—
BTC-LLMBackbone=Qwen3-14b, Bits=0.9bit2025.0562.65—
EPTSModel=LLaMA-7B, Criterion=M-S, Sparsity=40%2026.0662.65—
RIAModel=LLaMA2-7B, Criterion=S-S, Sparsity=40%2026.0662.62—
EPTSModel=LLaMA2-7B, Criterion=M-S, Sparsity=40%2026.0662.37—
SparseGPTModel=LLaMA-7B, Criterion=S-S, Sparsity=40%2026.0662.25—
RIAModel=LLaMA3-8B, Criterion=S-S, Sparsity=50%2026.0662.18—
BTC-LLMBackbone=Qwen3-8b, Bits=0.8bit2025.0562.11—
SparseGPTModel=LLaMA2-7B, Criterion=S-S, Sparsity=40%2026.0662.04—
RIAModel=LLaMA-7B, Criterion=S-S, Sparsity=40%2026.0661.99—
WandaModel=LLaMA-7B, Criterion=S-S, Sparsity=40%2026.0661.9—
WandaModel=LLaMA3-8B, Criterion=S-S, Sparsity=50%2026.0661.3—
BTC-LLMBackbone=Qwen3-14b, Bits=0.8bit2025.0560.71—
DenseArchitecture=Vicuna-7B, Sparsity=0%2026.0660.36—
SparseGPTModel=LLaMA2-7B, Criterion=S-S, Sparsity=50%2026.0660.28—
EPTSModel=LLaMA3-8B, Criterion=M-S, Sparsity=50%2026.0660.26—
WandaModel=LLaMA2-7B, Criterion=S-S, Sparsity=50%2026.0660.18—
DenseModel=LLaMA-2 70B, Sparsity (%)=0.002025.09600
RIAModel=LLaMA-7B, Criterion=S-S, Sparsity=50%2026.0659.93—
RIAModel=LLaMA2-7B, Criterion=S-S, Sparsity=50%2026.0659.83—
BTC-LLMBackbone=Qwen2.5-3b, Bits=0.9bit2025.0559.8—
DenseArchitecture=LLaMA-2-7B, Sparsity=0%2026.0659.69—
DenseModel=LLaMA 65B, Sparsity (%)=0.002025.0959.280
BTC-LLMBackbone=Qwen3-8b, Bits=0.7bit2025.0559—
SparseGPTModel=LLaMA-7B, Criterion=S-S, Sparsity=50%2026.0658.88—
WandaModel=LLaMA-2 70B, Sparsity (%)=50.002025.0958.81-1.19
EMP-WandaModel=LLaMA-2 70B, Sparsity (%)=40.322025.0958.74-1.26
EPTSModel=LLaMA2-7B, Criterion=M-S, Sparsity=50%2026.0658.62—
EMP-MagnitudeModel=LLaMA-2 70B, Sparsity (%)=36.662025.0958.57-1.43
WandaModel=LLaMA-7B, Criterion=S-S, Sparsity=50%2026.0658.27—
BTC-LLMBackbone=Qwen3-14b, Bits=0.7bit2025.0558.23—
EPTSModel=LLaMA-7B, Criterion=M-S, Sparsity=50%2026.0657.9—
MagnitudeModel=LLaMA-2 70B, Sparsity (%)=50.002025.0957.7-2.3
WandaModel=LLaMA 65B, Sparsity (%)=50.002025.0957.4-1.88
DenseArchitecture=LLaMA-3.2-3B, Sparsity=0%2026.0657.24—
EMP-WandaModel=LLaMA 65B, Sparsity (%)=39.992025.0957.08-2.2
BTC-LLMBackbone=Qwen2.5-14b, Bits=0.7bit2025.0556.98—
EMP-MagnitudeModel=LLaMA 65B, Sparsity (%)=36.612025.0956.95-2.33
BTC-LLMBackbone=Qwen2.5-3b, Bits=0.8bit2025.0555.88—
MagnitudeModel=LLaMA 65B, Sparsity (%)=50.002025.0955.83-3.45
EPTSModel=LLaMA-7B, Criterion=M-S, Sparsity=60%2026.0655.35—
SparseGPTModel=LLaMA3-8B, Criterion=S-S, Sparsity=60%2026.0655.31—
SparseGPTModel=LLaMA2-7B, Criterion=S-S, Sparsity=60%2026.0655.21—
DenseModel=LLaMA 30B, Sparsity (%)=0.002025.0954.840
EMP-MagnitudeModel=LLaMA 30B, Sparsity (%)=36.602025.0954.82-0.02
SparseGPTModel=LLaMA-7B, Criterion=S-S, Sparsity=60%2026.0654.75—
EPTSModel=LLaMA2-7B, Criterion=M-S, Sparsity=60%2026.0654.43—
EPTSModel=LLaMA3-8B, Criterion=M-S, Sparsity=60%2026.0654.22—
WandaModel=LLaMA 30B, Sparsity (%)=50.002025.0954.16-0.68
RIAModel=LLaMA2-7B, Criterion=S-S, Sparsity=60%2026.0654.14—
WandaModel=LLaMA-7B, Criterion=S-S, Sparsity=60%2026.0653.97—
WandaModel=LLaMA2-7B, Criterion=S-S, Sparsity=60%2026.0653.95—
DenseModel=LLaMA-2 13B, Sparsity (%)=0.002025.0953.640
DenseModel=LLaMA 13B, Sparsity (%)=0.002025.0953.60
MagnitudeModel=LLaMA 30B, Sparsity (%)=50.002025.0953.57-1.27
EMP-MagnitudeModel=LLaMA-2 13B, Sparsity (%)=36.622025.0952.93-0.71
EMP-WandaModel=LLaMA 30B, Sparsity (%)=40.182025.0952.9-1.94
EMP-WandaModel=LLaMA 13B, Sparsity (%)=40.682025.0952.74-0.86
MagnitudeModel=LLaMA-2 13B, Sparsity (%)=50.002025.0952.59-1.05
RIAModel=LLaMA3-8B, Criterion=S-S, Sparsity=60%2026.0652.4—
RIAModel=LLaMA-7B, Criterion=S-S, Sparsity=60%2026.0652.28—
WandaModel=LLaMA-2 13B, Sparsity (%)=50.002025.0952.12-1.52
EMP-MagnitudeModel=LLaMA 13B, Sparsity (%)=36.582025.0952.02-1.58
WandaModel=LLaMA 13B, Sparsity (%)=50.002025.0952-1.6
EMP-WandaModel=LLaMA-2 13B, Sparsity (%)=40.482025.0951.96-1.68
SparseGPT w. MRPArchitecture=LLaMA-2-13B, Sparsity=70%2026.0651.87—