Language Generation on C4 sampled (test)
6.97PerplexityFP16
Evaluation results
| Method | Links | |
|---|---|---|
| FP16Bits=-, Backbone=LLAMA-2-7B2026.04 | 6.97 | |
| LBLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B2026.04 | 10.91 | |
| CBQBits=W4A4, Backbone=LLAMA-2-7B2026.04 | 12.56 | |
| BWABits=W(1+1)A4, Backbone=LLAMA-2-7B2026.04 | 12.74 | |
| ARB-LLMBits=W(1+1)A4, Backbone=LLAMA-2-7B2026.04 | 20.88 | |
| BiLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B2026.04 | 40.52 | |
| QuaRotBits=W2A4, Backbone=LLAMA-2-7B2026.04 | 80.14 | |
| BWA w/o CBits=W(1+1)A4, Backbone=LLAMA-2-7B2026.04 | 433 |