Zero-shot Classification on Winogrande v1.1 (val)
77AccuracyUnquantized
Evaluation results
| Method | Links | |
|---|---|---|
| UnquantizedBackbone=LLaMa-2 70B, Avg Bits=162024.05 | 77 | |
| CALDERABackbone=LLaMa-3 8B, Rank=256, B_L (= B_R)=4, Avg Bits=2.42024.05 | 69.7 | |
| CALDERABackbone=LLaMa-2 7B, Rank=256, B_L (= B_R)=4, Avg Bits=2.42024.05 | 66 |