List your company
ResearchFormerly WizWand

Long-context retrieval on NIAH-Single-2 32K context

99.8Accuracy+QK-Restore
56.1267.4678.890.14Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
+QK-RestoreModel=HypeNet-5B2026.0699.8
Pre-trainModel=HypeNet-5B2026.0699.4
+SFTModel=HypeNet-5B2026.0698.8
+QK-RestoreModel=HypeNet-2B2026.0697.6
Pre-trainModel=Jet-Nemotron-2B2026.0695.6
+QK-RestoreModel=HypeNet-9B2026.0692.6
+SFTModel=HypeNet-9B2026.0689
+SFTModel=HypeNet-2B2026.0682.2
Pre-trainModel=HypeNet-2B2026.0675.8
+QK-RestoreModel=Jet-Nemotron-2B2026.0664.6
Pre-trainModel=HypeNet-9B2026.0664.2
+SFTModel=Jet-Nemotron-2B2026.0657.8