List your company

Needle-in-a-haystack Context Scaling on NIAH

100NIAH Success Rate (32K Context)Qwen3-4B
94.896.1597.598.85Feb 12, 2026

Evaluation results

MethodLinks
Qwen3-4BScaling=YaRN2026.0210010088.3341.6723.3316.673.331.7
Qwen3-8BScaling=YaRN2026.0210010088.3341.6723.3316.673.331.7
Qwen3-14BScaling=YaRN2026.0210010088.3341.6723.3316.673.331.7
StateLM-14BSearch mechanism=w/o search2026.0210010099.4497.7889.4594.449583.89
StateLM-8BSearch mechanism=w/o search2026.0299.4498.3398.3399.4495.5588.8988.8967.22
StateLM-4BSearch mechanism=w/o search2026.029595.5695.5688.3376.6762.7853.8932.22