List your company
ResearchFormerly WizWand

Quantization on LLaMA3-8B

27Averaged Quantization Time (s)SingleQuant
-965.885,736.0612,43819,139.94Nov 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SingleQuantHardware=NVIDIA A800 80GB GPU, Number of trials=302025.1127
Du QuantHardware=NVIDIA A800 80GB GPU, Number of trials=302025.1160
OST QuantHardware=NVIDIA A800 80GB GPU, Number of trials=302025.112,226
Spin QuantHardware=NVIDIA A800 80GB GPU, Number of trials=302025.1124,849