Formal Language Modeling on Formal Language Tasks (val)
100Cycle NavigationLSTM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LSTMArchitecture Category=Recurrent2026.07 | 100 | 100 | 99.9 | 100 | 100 | |
| BDArchitecture Category=Parallel, Hidden Dimension (dh)=128, Block Size (b)=42026.07 | 99.8 | 85.9 | 54 | 95.3 | 83.8 | |
| DPLRArchitecture Category=Parallel, Hidden Dimension (dh)=57, Rank (r)=42026.07 | 81.1 | 100 | 68.3 | 91 | 85.1 | |
| D–DEArchitecture Category=Parallel, Hidden Dimension (dh)=272, Block Size (b)=162026.07 | 73.3 | 84.8 | 98.4 | 83.8 | 85.1 | |
| WHArchitecture Category=Parallel, Hidden Dimension (dh)=1282026.07 | 69.7 | 93.1 | 20.5 | 50.7 | 58.5 | |
| DiagonalArchitecture Category=Parallel, Hidden Dimension (dh)=5122026.07 | 59.7 | 100 | 20.9 | 100 | 70.2 | |
| Gated DeltaNetArchitecture Category=Parallel2026.07 | 53.8 | 100 | 42.8 | 56.5 | 63.3 | |
| xLSTM[1:1]Architecture Category=Recurrent2026.07 | 53.5 | 99 | 29.3 | 100 | 70.5 | |
| mLSTMArchitecture Category=Parallel2026.07 | 52.4 | 99.9 | 28.8 | 53 | 58.5 | |
| DeltaNetArchitecture Category=Parallel2026.07 | 49.8 | 100 | 42.2 | 57.8 | 62.5 | |
| MambaArchitecture Category=Parallel2026.07 | 48.4 | 100 | 33.1 | 54.2 | 58.9 | |
| DeltaNet[−1, 1]Architecture Category=Parallel2026.07 | 46.7 | 100 | 66.4 | 97.7 | 77.7 | |
| Gated DeltaProduct[-1,1]Architecture Category=Parallel2026.07 | 46.3 | 100 | 78.4 | 98 | 80.7 | |
| RWKV-7Architecture Category=Parallel2026.07 | 37.8 | 88.1 | 39.5 | 51.1 | 54.1 | |
| sLSTMArchitecture Category=Recurrent2026.07 | 32.5 | 100 | 27.7 | 100 | 65.1 | |
| TransformerArchitecture Category=Parallel2026.07 | 24.4 | 90.4 | 23.6 | 52.2 | 47.7 | |
| S4DArchitecture Category=Parallel2026.07 | 23.7 | 68.7 | 21.7 | 51.2 | 41.3 | |
| Random2026.07 | 20 | 50 | 20 | 50 | 35 |