Language Modeling on Llama-2 13B
4.85Perplexity (PPL)FP16
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| FP162026.03 | 4.85 | 26 | 259 | — | |
| RAMPzero-shot=true2026.03 | 4.95 | 7.24 | — | — | |
| Direct SAC2026.03 | 4.96 | 7.25 | 0.1 | 0.2 | |
| AWQ-42026.03 | 4.97 | 7.68 | 6.1 | 0.4 | |
| Q4_K_M2026.03 | 4.98 | 7.73 | 6.8 | 0.6 | |
| GPTQ-42026.03 | 5.02 | 7.68 | 6.1 | 1.4 | |
| QLoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.09 | 6.89 | — | — | — | |
| CoA-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.09 | 6.99 | — | — | — | |
| QLoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.09 | 7.09 | — | — | — | |
| CoA-LoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.09 | 7.15 | — | — | — | |
| GPTQ-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.09 | 7.15 | — | — | — | |
| Shared-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.09 | 7.28 | — | — | — | |
| LQ-LoRAAvg. Bit=4, Rank=64, Model=LLaMA-2-13B2025.09 | 7.32 | — | — | — | |
| QLoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.09 | 7.48 | — | — | — | |
| LQ-LoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.09 | 7.52 | — | — | — | |
| Unbiased2025.05 | 7.565 | — | — | — | |
| CoA-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.09 | 7.58 | — | — | — | |
| Shared-LoRAAvg. Bit=3.5, Rank=64, Model=LLaMA-2-13B2025.09 | 7.59 | — | — | — | |
| DiPmark2025.05 | 7.681 | — | — | — | |
| E2E-LLM-Watermarkdelta=1.25, k=202025.05 | 7.73 | — | — | — | |
| GPTQ-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.09 | 7.95 | — | — | — | |
| LQ-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.09 | 8 | — | — | — | |
| Shared-LoRAAvg. Bit=3, Rank=64, Model=LLaMA-2-13B2025.09 | 8.18 | — | — | — | |
| TSW2025.05 | 8.466 | — | — | — | |
| SWEETdelta=22025.05 | 8.522 | — | — | — | |
| SIRdelta=12025.05 | 8.566 | — | — | — | |
| CoA-LoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.09 | 8.65 | — | — | — | |
| KGWdelta=22025.05 | 8.658 | — | — | — | |
| Shared-LoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.09 | 8.87 | — | — | — | |
| QLoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.09 | 9.11 | — | — | — | |
| LQ-LoRAAvg. Bit=2.5, Rank=64, Model=LLaMA-2-13B2025.09 | 9.23 | — | — | — | |
| Unigramdelta=22025.05 | 9.275 | — | — | — |