List your company
ResearchFormerly WizWand

Needle-in-a-Haystack retrieval on NIAH-Single 128K context 2

98.6AccuracyQwen3+YaRN
-3.94422.67849.375.922Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Qwen3+YaRNBackbone=8B, LS. Tokens=-2026.0698.6
FlashMorphBackbone=1.7B, LS. Tokens=20M2026.0698.2
HALOBackbone=1.7B, LS. Tokens=234M2026.0695
HALOBackbone=8B, LS. Tokens=234M2026.0689.2
FlashMorphBackbone=8B, LS. Tokens=20M2026.0685.6
Qwen3+YaRNBackbone=30B-A3B, LS. Tokens=-2026.0679.6
PostNAS*Backbone=1.7B, LS. Tokens=50B2026.0678
HALOBackbone=0.6B, LS. Tokens=234M2026.0662.4
HALOBackbone=30B-A3B, LS. Tokens=234M2026.0661.2
KL-LSBackbone=0.6B, LS. Tokens=20B2026.0650.2
KL-LSBackbone=1.7B, LS. Tokens=20B2026.0647.4
FlashMorphBackbone=0.6B, LS. Tokens=20M2026.0645.8
UniformBackbone=0.6B, LS. Tokens=N/A2026.0641.2
UniformBackbone=30B-A3B, LS. Tokens=N/A2026.0635.4
UniformBackbone=8B, LS. Tokens=N/A2026.0631.6
UniformBackbone=1.7B, LS. Tokens=N/A2026.0628.4
FlashMorphBackbone=30B-A3B, LS. Tokens=20M2026.0621.4
Qwen3+YaRNBackbone=1.7B, LS. Tokens=-2026.061.8
Qwen3Backbone=0.6B, LS. Tokens=-2026.060
Qwen3+YaRNBackbone=0.6B, LS. Tokens=-2026.060
Qwen3Backbone=1.7B, LS. Tokens=-2026.060
Qwen3Backbone=8B, LS. Tokens=-2026.060
Qwen3Backbone=30B-A3B, LS. Tokens=-2026.060