Question Answering on CoQA (val)
67.83EMfp16 (our run)
Evaluation results
| Method | Links | |
|---|---|---|
| fp16 (our run)bits=16.02026.05 | 67.83 | |
| fp16 (KIVI paper)bits=16.02026.05 | 67.4 | |
| HQMQ s96 r4 + Med3×bits=4.412026.05 | 67.38 | |
| KIVI-4 (calib.)bits=4.52026.05 | 66.95 | |
| KIVI-2 (calib.)bits=2.52026.05 | 66.35 | |
| HQMQ s96 r4bits=3.792026.05 | 65.83 | |
| HQMQ s24 r2bits=2.792026.05 | 58.58 | |
| naive int2bits=2.002026.05 | 0 |