List your company
ResearchFormerly WizWand

Language Modeling on Llama-2 13B

4.85Perplexity (PPL)FP16
4.6735.867757.06258.25725May 5, 2025Jun 26, 2025Aug 18, 2025Oct 10, 2025Dec 2, 2025Jan 24, 2026Mar 18, 2026
Updated 6mo ago

Evaluation results

MethodLinks
FP162026.034.8526259—
RAMPzero-shot=true2026.034.957.24——
Direct SAC2026.034.967.250.10.2
AWQ-42026.034.977.686.10.4
Q4_K_M2026.034.987.736.80.6
GPTQ-42026.035.027.686.11.4
QLoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.096.89———
CoA-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.096.99———
QLoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.097.09———
CoA-LoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.097.15———
GPTQ-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.097.15———
Shared-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.097.28———
LQ-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.097.32———
QLoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.097.48———
LQ-LoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.097.52———
Unbiased2025.057.565———
CoA-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.097.58———
Shared-LoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.097.59———
DiPmark2025.057.681———
E2E-LLM-Watermarkdelta=1.25, k=202025.057.73———
GPTQ-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.097.95———
LQ-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.098———
Shared-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.098.18———
TSW2025.058.466———
SWEETdelta=22025.058.522———
SIRdelta=12025.058.566———
CoA-LoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.098.65———
KGWdelta=22025.058.658———
Shared-LoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.098.87———
QLoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.099.11———
LQ-LoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.099.23———
Unigramdelta=22025.059.275———