Number in Haystack Retrieval on S-NIAH-2 number
100Accuracy (1K Context)Mamba2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mamba2Scale=500M2026.05 | 100 | 100 | 97.6 | 45.2 | |
| Gated DeltaNetScale=500M2026.05 | 100 | 100 | 84.6 | 24.8 | |
| CCQ-Gated DeltaNetScale=500M2026.05 | 100 | 99 | 87 | 50.8 | |
| Mamba2Scale=1.3B2026.05 | 100 | 100 | — | 55.8 | |
| GLAScale=1.3B2026.05 | 100 | 99.4 | 93.6 | 31.2 | |
| Gated DeltaNetScale=1.3B2026.05 | 100 | 100 | 83.4 | 56.6 | |
| CCQ-GLAScale=1.3B2026.05 | 100 | 100 | 99.4 | 60.6 | |
| CCQ-Gated DeltaNetScale=1.3B2026.05 | 100 | 100 | 86 | 58.4 | |
| GLAScale=500M2026.05 | 99.8 | 94.8 | 41.6 | 13.8 | |
| CCQ-GLAScale=500M2026.05 | 99.8 | 100 | 93.6 | 27.8 | |
| GLA-HedgehogScale=1.3B2026.05 | 99.8 | 98.4 | 62.4 | 3.6 | |
| TransformerScale=1.3B2026.05 | 99.8 | 100 | 99 | 0 | |
| GLA-HedgehogScale=500M2026.05 | 93.8 | 85.6 | 16.4 | 0 | |
| TransformerScale=500M2026.05 | 40.2 | 98.2 | 91.2 | 0 |