Language Modeling on Mistral-7B Long-context (8k window)
4.568Perplexityfp16
Evaluation results
| Method | Links | |
|---|---|---|
| fp16bits=16.00, evaluation protocol=single-window2026.05 | 4.568 | |
| hqmq_s192_r6bits=4.54, evaluation protocol=single-window2026.05 | 4.612 | |
| hqmq_s192_r4bits=4.04, evaluation protocol=single-window2026.05 | 4.616 | |
| hqmq_s96_r4bits=3.79, evaluation protocol=single-window2026.05 | 4.637 | |
| naive int4bits=4.00, evaluation protocol=single-window2026.05 | 4.663 | |
| hqmq_s24_r4bits=3.29, evaluation protocol=single-window2026.05 | 4.749 | |
| hqmq_s24_r3bits=3.04, evaluation protocol=single-window2026.05 | 4.82 | |
| naive int3bits=3.00, evaluation protocol=single-window2026.05 | 5.857 |