List your company
ResearchFormerly WizWand

Language Modeling on C4 (Perplexity and Efficiency Metrics)

12.701Perplexityfp16 baseline
5.8476852.1075998.3675144.62741May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
fp16 baselinebits=–, context length=4096, symmetric K=V=True2026.0512.70101
OCTOPUS-QJLbits=4, context length=4096, symmetric K=V=True2026.0512.8931.52
OCTOPUSbits=4, context length=4096, symmetric K=V=True2026.0512.8961.52.2
TurboQuant-MSEbits=4, context length=4096, symmetric K=V=True2026.0512.9211.72.2
PolarQuantbits=4, context length=4096, symmetric K=V=True2026.0513.0913.12.2
OCTOPUSbits=3, context length=4096, symmetric K=V=True2026.0513.4465.92.5
OCTOPUS-QJLbits=3, context length=4096, symmetric K=V=True2026.0513.4746.12.3
TurboQuant-QJLbits=4, context length=4096, symmetric K=V=True2026.0513.6997.92.2
TurboQuant-MSEbits=3, context length=4096, symmetric K=V=True2026.0513.7618.32.6
PolarQuantbits=3, context length=4096, symmetric K=V=True2026.0514.71615.92.6
OCTOPUS-QJLbits=2, context length=4096, symmetric K=V=True2026.0517.95541.42.6
OCTOPUSbits=2, context length=4096, symmetric K=V=True2026.0517.97641.52.9
TurboQuant-QJLbits=3, context length=4096, symmetric K=V=True2026.0520.30859.92.5
TurboQuant-MSEbits=2, context length=4096, symmetric K=V=True2026.0522.53677.43
PolarQuantbits=2, context length=4096, symmetric K=V=True2026.0561.486384.13
TurboQuant-QJLbits=2, context length=4096, symmetric K=V=True2026.05184.0341,3493