KV Cache Quantization on Mistral
0.0012ΔPPLTurboAngle norm8
Evaluation results
| Method | Links | |
|---|---|---|
| TurboAngle norm8Total bits=7.81, Calibration=No2026.03 | 0.0012 | |
| TurboAngle K8V4-logTotal bits=6.56, Calibration=No2026.03 | 0.0014 | |
| CQ-2c8bTotal bits=4.00, Calibration=Yes2026.03 | 0.03 |