Single-needle retrieval on NIAH-Single-2 64K
100AccuracyQwen3
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3Backbone=8B, LS. Tokens=-2026.06 | 100 | |
| Qwen3Backbone=30B-A3B, LS. Tokens=-2026.06 | 99.8 | |
| Qwen3+YaRNBackbone=8B, LS. Tokens=-2026.06 | 99.6 | |
| FlashMorphBackbone=8B, LS. Tokens=20M2026.06 | 99.4 | |
| HALOBackbone=8B, LS. Tokens=234M2026.06 | 95.6 | |
| HALOBackbone=30B-A3B, LS. Tokens=234M2026.06 | 79.4 | |
| Qwen3+YaRNBackbone=30B-A3B, LS. Tokens=-2026.06 | 61 | |
| UniformBackbone=8B, LS. Tokens=N/A2026.06 | 60.6 | |
| FlashMorphBackbone=30B-A3B, LS. Tokens=20M2026.06 | 53.6 | |
| UniformBackbone=30B-A3B, LS. Tokens=N/A2026.06 | 53.4 |