Needle-in-a-Haystack retrieval on NIAH Single 64K context 2
100AccuracyFlashMorph
Evaluation Results
| Method | Links | |
|---|---|---|
| FlashMorphBackbone=1.7B, LS. Tokens=20M2026.06 | 100 | |
| Qwen3Backbone=0.6B, LS. Tokens=-2026.06 | 99 | |
| Qwen3Backbone=1.7B, LS. Tokens=-2026.06 | 98.8 | |
| HALOBackbone=1.7B, LS. Tokens=234M2026.06 | 98.6 | |
| PostNAS*Backbone=1.7B, LS. Tokens=50B2026.06 | 95.6 | |
| UniformBackbone=1.7B, LS. Tokens=N/A2026.06 | 86.8 | |
| FlashMorphBackbone=0.6B, LS. Tokens=20M2026.06 | 82.4 | |
| HALOBackbone=0.6B, LS. Tokens=234M2026.06 | 80.6 | |
| KL-LSBackbone=1.7B, LS. Tokens=20B2026.06 | 68.6 | |
| KL-LSBackbone=0.6B, LS. Tokens=20B2026.06 | 60.6 | |
| UniformBackbone=0.6B, LS. Tokens=N/A2026.06 | 49.2 | |
| Qwen3+YaRNBackbone=1.7B, LS. Tokens=-2026.06 | 8.8 | |
| Qwen3+YaRNBackbone=0.6B, LS. Tokens=-2026.06 | 0 |