List your company
ResearchFormerly WizWand

Multi-key Needle-in-a-Haystack Recall on 8k Context Length

100Needle-in-a-Haystack Recall (8k Context)fp16 baseline
-4235077May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
fp16 baselinebits=–, codec=fp16 baseline, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
TurboQuant-MSEbits=4, codec=TurboQuant-MSE, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
TurboQuant-QJLbits=4, codec=TurboQuant-QJL, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
PolarQuantbits=4, codec=PolarQuant, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
OCTOPUSbits=4, codec=OCTOPUS, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
TurboQuant-MSEbits=3, codec=TurboQuant-MSE, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
OCTOPUSbits=3, codec=OCTOPUS, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
OCTOPUS-QJLbits=3, codec=OCTOPUS-QJL, Backbone=Qwen2.5-7B-Instruct-1M2026.05100
OCTOPUS-QJLbits=4, codec=OCTOPUS-QJL, Backbone=Qwen2.5-7B-Instruct-1M2026.0595
OCTOPUSbits=2, codec=OCTOPUS, Backbone=Qwen2.5-7B-Instruct-1M2026.0590
OCTOPUS-QJLbits=2, codec=OCTOPUS-QJL, Backbone=Qwen2.5-7B-Instruct-1M2026.0585
PolarQuantbits=3, codec=PolarQuant, Backbone=Qwen2.5-7B-Instruct-1M2026.0575
TurboQuant-MSEbits=2, codec=TurboQuant-MSE, Backbone=Qwen2.5-7B-Instruct-1M2026.0570
TurboQuant-QJLbits=3, codec=TurboQuant-QJL, Backbone=Qwen2.5-7B-Instruct-1M2026.0565
PolarQuantbits=2, codec=PolarQuant, Backbone=Qwen2.5-7B-Instruct-1M2026.055
TurboQuant-QJLbits=2, codec=TurboQuant-QJL, Backbone=Qwen2.5-7B-Instruct-1M2026.050