List your company
ResearchFormerly WizWand

Language Modeling on C4 v1 (test)

6.63PerplexityLlama 2-7B
6.57926.92217.2657.6079Nov 19, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Llama 2-7BRatio=-, Avg bits=322025.116.63
QTIPRatio=∼ 8×, Avg bits=4.01, Weight Updation=Yes2025.116.69
AQLMRatio=∼ 8×, Avg bits=4.04, Weight Updation=Yes2025.116.75
QuIP#Ratio=∼ 8×, Avg bits=4.02, Weight Updation=Yes2025.116.86
PocketLLMRatio=∼ 8×, Avg bits=3.98, Weight Updation=Yes2025.116.86
SpQRRatio=∼ 8×, Avg bits=3.98, Weight Updation=Yes2025.116.87
VPTQRatio=∼ 8×, Avg bits=4.01, Weight Updation=Yes2025.117.13
GPTQRatio=∼ 8×, Avg bits=4.00, Weight Updation=Yes2025.117.2
PocketLLMRatio=∼ 8×, Avg bits=3.98, Weight Updation=No2025.117.49
DuQuantRatio=∼ 8×, Avg bits=4.00, Weight Updation=Yes2025.117.79
DuQuant*Ratio=∼ 8×, Avg bits=4.01, Weight Updation=No2025.117.9