Pass-key retrieval on S-NIAH-1 pass-key
100Accuracy (1K)Mamba2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mamba2Scale=500M2026.05 | 100 | 100 | 97.6 | 68.4 | |
| Gated DeltaNetScale=500M2026.05 | 100 | 100 | 100 | 100 | |
| CCQ-GLAScale=500M2026.05 | 100 | 97.6 | 56.4 | 20.6 | |
| CCQ-Gated DeltaNetScale=500M2026.05 | 100 | 100 | 100 | 99.6 | |
| TransformerScale=500M2026.05 | 100 | 100 | 97.8 | 0 | |
| GLAScale=1.3B2026.05 | 100 | 86.4 | 47.8 | 13 | |
| Gated DeltaNetScale=1.3B2026.05 | 100 | 99.8 | 100 | 99.8 | |
| CCQ-GLAScale=1.3B2026.05 | 100 | 100 | 96.8 | 42.6 | |
| CCQ-Gated DeltaNetScale=1.3B2026.05 | 100 | 99.8 | 100 | 98.2 | |
| TransformerScale=1.3B2026.05 | 100 | 100 | 99.8 | 0 | |
| Mamba2Scale=1.3B2026.05 | 99.8 | 100 | 100 | 99.2 | |
| GLA-HedgehogScale=1.3B2026.05 | 92.4 | 96 | 75 | 6.2 | |
| GLAScale=500M2026.05 | 88 | 26.2 | 11 | 5.2 | |
| GLA-HedgehogScale=500M2026.05 | 76.6 | 55.8 | 36.6 | 0 |