List your company
ResearchFormerly WizWand

Long-context retrieval on NIAH-Single-2 256K context

93.4AccuracyPre-train
4.16827.33450.573.666Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Pre-trainModel=HypeNet-5B2026.0693.4
+QK-RestoreModel=HypeNet-5B2026.0685.4
+SFTModel=HypeNet-5B2026.0683.6
Pre-trainModel=HypeNet-9B2026.0667.2
Pre-trainModel=HypeNet-2B2026.0656.2
+SFTModel=HypeNet-2B2026.0641.8
+QK-RestoreModel=HypeNet-2B2026.0640.8
Pre-trainModel=Jet-Nemotron-2B2026.0622.2
+QK-RestoreModel=HypeNet-9B2026.0619.6
+SFTModel=Jet-Nemotron-2B2026.0611.6
+SFTModel=HypeNet-9B2026.069.4
+QK-RestoreModel=Jet-Nemotron-2B2026.067.6