List your company
ResearchFormerly WizWand

Long-context retrieval on NIAH-Single-3 (256K)

76.4Accuracy+QK-Restore
7.96825.73443.561.266Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
+QK-RestoreModel=HypeNet-5B2026.0676.4
Pre-trainModel=HypeNet-5B2026.0675.2
+SFTModel=HypeNet-5B2026.0665.4
Pre-trainModel=HypeNet-9B2026.0652
+QK-RestoreModel=HypeNet-9B2026.0642.6
Pre-trainModel=Jet-Nemotron-2B2026.0640.6
+QK-RestoreModel=Jet-Nemotron-2B2026.0634
+QK-RestoreModel=HypeNet-2B2026.0630.2
+SFTModel=Jet-Nemotron-2B2026.0627.8
Pre-trainModel=HypeNet-2B2026.0623.4
+SFTModel=HypeNet-9B2026.0622.8
+SFTModel=HypeNet-2B2026.0610.6