Next Token Prediction on Wikitext2
7.64PerplexityLoRA (QV4)
Evaluation results
| Method | Links | |
|---|---|---|
| LoRA (QV4)W Bits=16, Backbone=OPT 66B2023.05 | 7.64 | |
| PEQAW Bits=4, Backbone=OPT 66B2023.05 | 7.86 | |
| LoRA (QV4)W Bits=16, Backbone=OPT 30B2023.05 | 7.93 | |
| PEQAW Bits=4, Backbone=OPT 30B2023.05 | 8.11 | |
| LoRA (QV4)W Bits=16, Backbone=OPT 13B2023.05 | 8.44 | |
| PEQAW Bits=4, Backbone=OPT 13B2023.05 | 8.74 | |
| LoRA (QV4)W Bits=16, Backbone=OPT 6.7B2023.05 | 8.96 | |
| PEQAW Bits=4, Backbone=OPT 6.7B2023.05 | 9.34 | |
| LoRA (QV4)W Bits=16, Backbone=OPT 2.7B2023.05 | 10.25 | |
| PEQAW Bits=4, Backbone=OPT 2.7B2023.05 | 10.78 | |
| LoRA (QV4)W Bits=16, Backbone=OPT 1.3B2023.05 | 11.58 | |
| PEQAW Bits=4, Backbone=OPT 1.3B2023.05 | 12.4 |