List your company
ResearchFormerly WizWand

Long-context retrieval on NIAH-Single-2 (128K context)

97AccuracyPre-train
14.21635.70857.278.692Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Pre-trainModel=HypeNet-5B2026.0697
+QK-RestoreModel=HypeNet-5B2026.0696.8
+SFTModel=HypeNet-5B2026.0691.4
Pre-trainModel=HypeNet-2B2026.0688
+QK-RestoreModel=HypeNet-2B2026.0683.2
Pre-trainModel=HypeNet-9B2026.0672.4
Pre-trainModel=Jet-Nemotron-2B2026.0661
+SFTModel=HypeNet-2B2026.0648.4
+QK-RestoreModel=HypeNet-9B2026.0644
+QK-RestoreModel=Jet-Nemotron-2B2026.0622
+SFTModel=Jet-Nemotron-2B2026.0621
+SFTModel=HypeNet-9B2026.0617.4