List your company
ResearchFormerly WizWand

Needle-in-a-Haystack retrieval on NIAH-Single-2 256K context

95.2AccuracyHALO
-3.80821.89647.673.304Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
HALOBackbone=1.7B, LS. Tokens=234M2026.0695.2
FlashMorphBackbone=1.7B, LS. Tokens=20M2026.0688.2
FlashMorphBackbone=8B, LS. Tokens=20M2026.0682.6
Qwen3+YaRNBackbone=8B, LS. Tokens=-2026.0674.8
PostNAS*Backbone=1.7B, LS. Tokens=50B2026.0673.8
Qwen3+YaRNBackbone=30B-A3B, LS. Tokens=-2026.0673
HALOBackbone=8B, LS. Tokens=234M2026.0668.4
KL-LSBackbone=1.7B, LS. Tokens=20B2026.0634.6
HALOBackbone=30B-A3B, LS. Tokens=234M2026.0627.6
KL-LSBackbone=0.6B, LS. Tokens=20B2026.0624
HALOBackbone=0.6B, LS. Tokens=234M2026.0621
UniformBackbone=1.7B, LS. Tokens=N/A2026.0619.2
UniformBackbone=30B-A3B, LS. Tokens=N/A2026.0619
UniformBackbone=8B, LS. Tokens=N/A2026.0617.8
UniformBackbone=0.6B, LS. Tokens=N/A2026.0612.8
FlashMorphBackbone=0.6B, LS. Tokens=20M2026.0611
Qwen3+YaRNBackbone=1.7B, LS. Tokens=-2026.0610.2
FlashMorphBackbone=30B-A3B, LS. Tokens=20M2026.069.6
Qwen3Backbone=0.6B, LS. Tokens=-2026.060
Qwen3+YaRNBackbone=0.6B, LS. Tokens=-2026.060
Qwen3Backbone=1.7B, LS. Tokens=-2026.060
Qwen3Backbone=8B, LS. Tokens=-2026.060
Qwen3Backbone=30B-A3B, LS. Tokens=-2026.060