Long-context Retrieval on NIAH Variants (1K-4K Contexts)
100Single-1 Acc (1K)Gated DeltaNet
Evaluation results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gated DeltaNetScale=180M, PoST=false2026.04 | 100 | 97.8 | 85.8 | 78.6 | 13.2 | 4.4 | 7.6 | 1.6 | 0.8 | 17.2 | 22.8 | 6 | 21.5 | 18.9 | 7.8 | 12.6 | 18.6 | 4.5 | 28.9 | |
| RWKV-7 + PoSTScale=180M, PoST=true2026.04 | 99.8 | 93.6 | 57.8 | 90.2 | 11.6 | 5.4 | 3 | 0.2 | 0 | 17.8 | 14 | 5.8 | 16.1 | 7.5 | 0.8 | 15.3 | 10.8 | 3 | 25.1 | |
| Mamba-2 + PoSTScale=440M, PoST=true2026.04 | 99.8 | 77.6 | 16.2 | 98.8 | 34.2 | 7.2 | 60.4 | 30.4 | 1.4 | 15.2 | 19.6 | 2.2 | 9.4 | 15.4 | 1.1 | 3.5 | 10.5 | 0.2 | 28 | |
| RWKV-7Scale=180M, PoST=false2026.04 | 99.6 | 97.4 | 62.6 | 66.8 | 11.8 | 12.4 | 0 | 0 | 0 | 17.8 | 16.8 | 8.8 | 14.1 | 13.1 | 3.3 | 16.2 | 11.5 | 7 | 25.5 | |
| Gated DeltaNet + PoSTScale=180M, PoST=true2026.04 | 99 | 99.6 | 77.6 | 98 | 14.4 | 12.6 | 10.2 | 1.8 | 1 | 21.4 | 25.2 | 12.2 | 12.8 | 5.6 | 0.9 | 16.9 | 19.1 | 8.8 | 29.8 | |
| Mamba-2Scale=440M, PoST=false2026.04 | 98.2 | 63.8 | 30.4 | 94.8 | 24.2 | 2.6 | 31.4 | 13.6 | 4 | 16.2 | 13.4 | 3.4 | 14.3 | 12 | 3.2 | 8.6 | 4 | 1.2 | 24.4 | |
| Mamba-2 + PoSTScale=180M, PoST=true2026.04 | 95.6 | 47.4 | 2 | 71 | 13.2 | 8.4 | 4.8 | 0.6 | 1.8 | 17 | 16 | 6.4 | 12.6 | 12.6 | 3.1 | 11.1 | 12 | 3.5 | 18.8 | |
| Mamba-2Scale=180M, PoST=false2026.04 | 44 | 5.6 | 0.2 | 15.4 | 3.6 | 0.8 | 0 | 0 | 0 | 9 | 6 | 1.6 | 8.5 | 5.5 | 1.4 | 4.9 | 4.5 | 1.7 | 6.3 |