Zero-shot Classification on Zero-shot Evaluation Suite (AC, AE, WI, QA) v1
46.2AC ScoreLoPRov-FT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LoPRov-FTModel=LLaMA2-13B, Bit=3.2, rank(bit)=2(8)2026.01 | 46.2 | 77.9 | 71.7 | 80.1 | |
| RILQModel=LLaMA2-13B, Bit=3.2, rank(bit)=32(16)2026.01 | 45.4 | 76.4 | 71.4 | 79.2 | |
| LoPRov-FTModel=LLaMA2-7B, Bit=3.2, rank(bit)=32(8)2026.01 | 42.8 | 76 | 68.9 | 77.2 | |
| LoPRov-FTModel=LLaMA2-13B, Bit=2.2, rank(bit)=32(8)2026.01 | 42.8 | 75.6 | 68.5 | 78.9 | |
| RILQModel=LLaMA2-7B, Bit=3.2, rank(bit)=32(16)2026.01 | 40.6 | 75.8 | 67.9 | 76.9 | |
| RILQModel=LLaMA2-13B, Bit=2.2, rank(bit)=32(16)2026.01 | 40.1 | 71.2 | 68.8 | 78.1 | |
| CALDERAModel=LLaMA2-13B, Bit=2.2, rank(bit)=128(4)2026.01 | 38.7 | 68.5 | 67.9 | 76 | |
| LoPRov-FTModel=LLaMA2-7B, Bit=2.2, rank(bit)=32(8)2026.01 | 38.1 | 70.9 | 64.8 | 76.1 | |
| RILQModel=LLaMA2-7B, Bit=2.2, rank(bit)=32(16)2026.01 | 37.4 | 70.1 | 66.5 | 75 | |
| CALDERAModel=LLaMA2-7B, Bit=2.2, rank(bit)=128(4)2026.01 | 34.6 | 65.1 | 63.8 | 75.1 |