Language Modeling on Mistral-7B Long-context (4k window)
5.241Perplexityfp16
Evaluation results
| Method | Links | |
|---|---|---|
| fp16bits=16.00, evaluation protocol=single-window2026.05 | 5.241 | |
| hqmq_s192_r4bits=4.04, evaluation protocol=single-window2026.05 | 5.273 | |
| hqmq_s192_r6bits=4.54, evaluation protocol=single-window2026.05 | 5.277 | |
| naive int4bits=4.00, evaluation protocol=single-window2026.05 | 5.331 | |
| hqmq_s96_r4bits=3.79, evaluation protocol=single-window2026.05 | 5.332 | |
| hqmq_s24_r4bits=3.29, evaluation protocol=single-window2026.05 | 5.442 | |
| hqmq_s24_r3bits=3.04, evaluation protocol=single-window2026.05 | 5.532 | |
| naive int3bits=3.00, evaluation protocol=single-window2026.05 | 6.653 |