List your company
ResearchFormerly WizWand

Zero-shot Evaluation on Benchmarks 0-shot

73.330-shot Average ScoreFP16
57.10661.31865.5369.742Jun 5, 2025
Updated 3mo ago

Evaluation results

MethodLinks
FP16Model backbone=Llama-3 8B2025.0673.33
FP16Model backbone=Llama-2 13B2025.0672.55
FlatQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0671.64
FlatQuantWeight Quantizer=RTN, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0671.42
FlatQuantWeight Quantizer=GPTQ, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0671.33
FlatQuantWeight Quantizer=RTN, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0671.23
SpinQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0670.93
OSTQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0670.03
FPTQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0669.97
OSTQuantWeight Quantizer=RTN, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0669.87
FPTQuantWeight Quantizer=RTN, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0669.81
FP16Model backbone=Llama-2 7B2025.0669.79
QuaRotWeight Quantizer=GPTQ, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0668.91
SpinQuantWeight Quantizer=GPTQ, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0668.7
FPTQuantWeight Quantizer=GPTQ, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0668.7
OSTQuantWeight Quantizer=GPTQ, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0668.64
SpinQuantWeight Quantizer=RTN, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0668.56
FPTQuantWeight Quantizer=RTN, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0668.41
OSTQuantWeight Quantizer=RTN, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0668.32
FlatQuantWeight Quantizer=RTN, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0667.96
FlatQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0667.47
SpinQuantWeight Quantizer=RTN, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0666.98
OSTQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0666.58
FPTQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0666.44
QuaRotWeight Quantizer=RTN, Model backbone=Llama-2 13B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0666.25
SpinQuantWeight Quantizer=GPTQ, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0666.23
FPTQuantWeight Quantizer=RTN, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0666.06
OSTQuantWeight Quantizer=RTN, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0665.88
QuaRotWeight Quantizer=GPTQ, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0665.79
QuaRotWeight Quantizer=GPTQ, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0665.01
SpinQuantWeight Quantizer=RTN, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0663.52
QuaRotWeight Quantizer=RTN, Model backbone=Llama-3 8B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0661.34
QuaRotWeight Quantizer=RTN, Model backbone=Llama-2 7B, Quantization format=W4A4KV4, Quantization mode=Dynamic2025.0657.73