List your company
ResearchFormerly WizWand

Zero-shot Evaluation on Zero-shot Benchmarks Average

68.6Average AccuracyBF16
31.36841.03450.760.366Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
BF16Bit-width=3-bit, Model=Llama-3 8B2026.0668.6
BF16Bit-width=4-bit, Model=Llama-3 8B2026.0668.6
GPTQ + PiSOBit-width=4-bit, Model=Llama-3 8B2026.0668.3
GPTQ ⊙ PiSOBit-width=4-bit, Model=Llama-3 8B2026.0668.1
Qronos + PiSOBit-width=4-bit, Model=Llama-3 8B2026.0667.4
RTN + PiSOBit-width=4-bit, Model=Llama-3 8B2026.0667.3
Qronos ⊙ PiSOBit-width=4-bit, Model=Llama-3 8B2026.0667
GPTQ + absmaxBit-width=4-bit, Model=Llama-3 8B2026.0665.6
Qronos + absmaxBit-width=4-bit, Model=Llama-3 8B2026.0665.2
RTN + absmaxBit-width=4-bit, Model=Llama-3 8B2026.0664.7
GPTQ + PiSOBit-width=3-bit, Model=Llama-3 8B2026.0663
Qronos ⊙ PiSOBit-width=3-bit, Model=Llama-3 8B2026.0662.7
GPTQ ⊙ PiSOBit-width=3-bit, Model=Llama-3 8B2026.0662.6
BF16Bit-width=3-bit, Model=Llama-3 3B2026.0662
BF16Bit-width=4-bit, Model=Llama-3 3B2026.0662
Qronos + PiSOBit-width=3-bit, Model=Llama-3 8B2026.0661.4
Qronos + PiSOBit-width=4-bit, Model=Llama-3 3B2026.0661.2
Qronos ⊙ PiSOBit-width=4-bit, Model=Llama-3 3B2026.0660.5
RTN + PiSOBit-width=4-bit, Model=Llama-3 3B2026.0660.4
GPTQ + PiSOBit-width=4-bit, Model=Llama-3 3B2026.0660.2
Qronos + absmaxBit-width=4-bit, Model=Llama-3 3B2026.0660.1
GPTQ ⊙ PiSOBit-width=4-bit, Model=Llama-3 3B2026.0660
RTN + PiSOBit-width=3-bit, Model=Llama-3 8B2026.0659.9
BeaconBit-width=4-bit, Model=Llama-3 8B2026.0659.7
GPTQ + absmaxBit-width=4-bit, Model=Llama-3 3B2026.0659.4
Qronos + absmaxBit-width=3-bit, Model=Llama-3 8B2026.0657.9
GPTQ ⊙ PiSOBit-width=3-bit, Model=Llama-3 3B2026.0655.9
Qronos ⊙ PiSOBit-width=3-bit, Model=Llama-3 3B2026.0655.6
RTN + absmaxBit-width=4-bit, Model=Llama-3 3B2026.0655.6
Qronos + PiSOBit-width=3-bit, Model=Llama-3 3B2026.0655.5
GPTQ + absmaxBit-width=3-bit, Model=Llama-3 8B2026.0655.1
GPTQ + PiSOBit-width=3-bit, Model=Llama-3 3B2026.0654.6
BeaconBit-width=3-bit, Model=Llama-3 8B2026.0653.5
BF16Bit-width=3-bit, Model=Llama-3 1B2026.0652.6
BF16Bit-width=4-bit, Model=Llama-3 1B2026.0652.6
RTN + PiSOBit-width=3-bit, Model=Llama-3 3B2026.0652.1
GPTQ + PiSOBit-width=4-bit, Model=Llama-3 1B2026.0652
Qronos + PiSOBit-width=4-bit, Model=Llama-3 1B2026.0651.5
Qronos + absmaxBit-width=3-bit, Model=Llama-3 3B2026.0651.4
GPTQ ⊙ PiSOBit-width=4-bit, Model=Llama-3 1B2026.0651.3
Qronos ⊙ PiSOBit-width=4-bit, Model=Llama-3 1B2026.0651.1
Qronos + absmaxBit-width=4-bit, Model=Llama-3 1B2026.0650.2
RTN + PiSOBit-width=4-bit, Model=Llama-3 1B2026.0650
GPTQ + absmaxBit-width=3-bit, Model=Llama-3 3B2026.0649.8
GPTQ + absmaxBit-width=4-bit, Model=Llama-3 1B2026.0649.3
Qronos + PiSOBit-width=3-bit, Model=Llama-3 1B2026.0648.6
Qronos ⊙ PiSOBit-width=3-bit, Model=Llama-3 1B2026.0648
GPTQ + PiSOBit-width=3-bit, Model=Llama-3 1B2026.0647.5
GPTQ ⊙ PiSOBit-width=3-bit, Model=Llama-3 1B2026.0647
RTN + absmaxBit-width=4-bit, Model=Llama-3 1B2026.0646.3
BeaconBit-width=4-bit, Model=Llama-3 3B2026.0646.3
BeaconBit-width=4-bit, Model=Llama-3 1B2026.0646.1
RTN + PiSOBit-width=3-bit, Model=Llama-3 1B2026.0644.2
BeaconBit-width=3-bit, Model=Llama-3 1B2026.0642.4
Qronos + absmaxBit-width=3-bit, Model=Llama-3 1B2026.0640.6
BeaconBit-width=3-bit, Model=Llama-3 3B2026.0640.1
GPTQ + absmaxBit-width=3-bit, Model=Llama-3 1B2026.0639.6
RTN + absmaxBit-width=3-bit, Model=Llama-3 8B2026.0638
RTN + absmaxBit-width=3-bit, Model=Llama-3 3B2026.0635.7
RTN + absmaxBit-width=3-bit, Model=Llama-3 1B2026.0632.8