List your company
ResearchFormerly WizWand

Needle-in-a-Haystack retrieval on NIAH-Single-3 256K context

94AccuracyFlashMorph
-3.7621.624772.38Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FlashMorphBackbone=8B, LS. Tokens=20M2026.0694
Qwen3+YaRNBackbone=8B, LS. Tokens=-2026.0692.8
FlashMorphBackbone=1.7B, LS. Tokens=20M2026.0673.2
PostNAS*Backbone=1.7B, LS. Tokens=50B2026.0657.6
HALOBackbone=1.7B, LS. Tokens=234M2026.0652.8
HALOBackbone=8B, LS. Tokens=234M2026.0650.8
HALOBackbone=0.6B, LS. Tokens=234M2026.0632.4
FlashMorphBackbone=0.6B, LS. Tokens=20M2026.0628.4
UniformBackbone=1.7B, LS. Tokens=N/A2026.0627.8
UniformBackbone=8B, LS. Tokens=N/A2026.0626.2
FlashMorphBackbone=30B-A3B, LS. Tokens=20M2026.0618.2
UniformBackbone=0.6B, LS. Tokens=N/A2026.0612.2
UniformBackbone=30B-A3B, LS. Tokens=N/A2026.069.6
Qwen3+YaRNBackbone=30B-A3B, LS. Tokens=-2026.069
KL-LSBackbone=1.7B, LS. Tokens=20B2026.063.8
KL-LSBackbone=0.6B, LS. Tokens=20B2026.063.6
HALOBackbone=30B-A3B, LS. Tokens=234M2026.060.8
Qwen3+YaRNBackbone=1.7B, LS. Tokens=-2026.060.2
Qwen3Backbone=0.6B, LS. Tokens=-2026.060
Qwen3+YaRNBackbone=0.6B, LS. Tokens=-2026.060
Qwen3Backbone=1.7B, LS. Tokens=-2026.060
Qwen3Backbone=8B, LS. Tokens=-2026.060
Qwen3Backbone=30B-A3B, LS. Tokens=-2026.060