Language Modeling on LLaMA-2 Family Evaluation v2 (test)
4.8PPLLoPRov-FT
Evaluation results
| Method | Links | |
|---|---|---|
| LoPRov-FTModel=LLaMA2-13B, Bit=3.2, rank(bit)=2(8)2026.01 | 4.8 | |
| RILQModel=LLaMA2-13B, Bit=3.2, rank(bit)=32(16)2026.01 | 4.88 | |
| LoPRov-FTModel=LLaMA2-13B, Bit=2.2, rank(bit)=32(8)2026.01 | 5.34 | |
| LoPRov-FTModel=LLaMA2-7B, Bit=3.2, rank(bit)=32(8)2026.01 | 5.37 | |
| RILQModel=LLaMA2-13B, Bit=2.2, rank(bit)=32(16)2026.01 | 5.42 | |
| RILQModel=LLaMA2-7B, Bit=3.2, rank(bit)=32(16)2026.01 | 5.47 | |
| CALDERAModel=LLaMA2-13B, Bit=2.2, rank(bit)=128(4)2026.01 | 5.72 | |
| LoPRov-FTModel=LLaMA2-7B, Bit=2.2, rank(bit)=32(8)2026.01 | 6.06 | |
| RILQModel=LLaMA2-7B, Bit=2.2, rank(bit)=32(16)2026.01 | 6.28 | |
| CALDERAModel=LLaMA2-7B, Bit=2.2, rank(bit)=128(4)2026.01 | 6.79 |