List your company
ResearchFormerly WizWand

Needle-in-a-Haystack retrieval on NIAH-Single-3 128K context

98.8AccuracyQwen3+YaRN
-3.95222.72449.476.076Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Qwen3+YaRNBackbone=8B, LS. Tokens=-2026.0698.8
FlashMorphBackbone=1.7B, LS. Tokens=20M2026.0694.4
FlashMorphBackbone=8B, LS. Tokens=20M2026.0692.4
HALOBackbone=8B, LS. Tokens=234M2026.0675
HALOBackbone=1.7B, LS. Tokens=234M2026.0667.4
HALOBackbone=0.6B, LS. Tokens=234M2026.0657.2
PostNAS*Backbone=1.7B, LS. Tokens=50B2026.0657.2
FlashMorphBackbone=0.6B, LS. Tokens=20M2026.0645.6
UniformBackbone=8B, LS. Tokens=N/A2026.0640.6
UniformBackbone=0.6B, LS. Tokens=N/A2026.0628.8
Qwen3+YaRNBackbone=30B-A3B, LS. Tokens=-2026.0626.6
FlashMorphBackbone=30B-A3B, LS. Tokens=20M2026.0624.6
UniformBackbone=30B-A3B, LS. Tokens=N/A2026.0618.4
UniformBackbone=1.7B, LS. Tokens=N/A2026.0616.4
HALOBackbone=30B-A3B, LS. Tokens=234M2026.0612
KL-LSBackbone=1.7B, LS. Tokens=20B2026.069.4
KL-LSBackbone=0.6B, LS. Tokens=20B2026.068.6
Qwen3+YaRNBackbone=1.7B, LS. Tokens=-2026.060.8
Qwen3Backbone=0.6B, LS. Tokens=-2026.060
Qwen3+YaRNBackbone=0.6B, LS. Tokens=-2026.060
Qwen3Backbone=1.7B, LS. Tokens=-2026.060
Qwen3Backbone=8B, LS. Tokens=-2026.060
Qwen3Backbone=30B-A3B, LS. Tokens=-2026.060