Needle Retrieval on 4-digit-magic-number needle retrieval 4k window
100Accuracyfp16
Evaluation results
| Method | Links | |
|---|---|---|
| fp16bits=16.00, evaluation protocol=single-window2026.05 | 100 | |
| hqmq_s192_r4bits=4.04, evaluation protocol=single-window2026.05 | 100 | |
| naive int4bits=4.00, evaluation protocol=single-window2026.05 | 100 | |
| hqmq_s48_r4bits=3.54, evaluation protocol=single-window2026.05 | 100 | |
| hqmq_s24_r3bits=3.04, evaluation protocol=single-window2026.05 | 100 | |
| naive int3bits=3.00, evaluation protocol=single-window2026.05 | 91.7 |