Permuted Sequential Image Classification on MNIST Permuted Sequential
99.1Test Accuracy MeanSMPConv
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SMPConvParams.=373k2023.04 | 99.1 | — | — | — | |
| LSSL2023.04 | 98.76 | — | — | — | |
| S42023.04 | 98.7 | — | — | — | |
| FlexTCNParams.=375k2023.04 | 98.63 | — | — | — | |
| HiPPOParams.=0.5M2023.04 | 98.3 | — | — | — | |
| TrellisNetParams.=8M2023.04 | 98.13 | — | — | — | |
| CKCNNParams.=98k2023.04 | 98 | — | — | — | |
| CoRNNParams.=134k2023.04 | 97.3 | — | — | — | |
| TCNParams.=70k2023.04 | 97.2 | — | — | — | |
| TCNSize=42K2018.03 | 97.2 | — | — | — | |
| URLSTM2023.04 | 96.96 | — | — | — | |
| Sparse Combo NetStable RNN?=true, Params=130K2021.06 | 96.85 | 96.65 | 96.94 | 4 | |
| coRNNnumber of units=128, number of parameters=34k2024.09 | 96.6 | — | — | — | |
| Lipschitz RNNnumber of units=128, number of parameters=34k2024.09 | 96.3 | — | — | — | |
| DilRNNParams.=44k2023.04 | 96.1 | — | — | — | |
| IndRNNParams.=83k2023.04 | 96 | — | — | — | |
| LipschitzStable RNN?=true, Params=134K2021.06 | 95.9 | 95.6 | 96.3 | 10 | |
| ZoneoutSize=42K2018.03 | 95.9 | — | — | — | |
| AntisymmetricRNNnumber of units=128, number of parameters=10k2024.09 | 95.8 | — | — | — | |
| r-LSTMParams.=500k2023.04 | 95.2 | — | — | — | |
| stanhs=21, l=12016.02 | 94 | — | — | — | |
| LSTMsnumber of units=128, number of parameters=68k2024.09 | 92.6 | — | — | — | |
| uRNN2016.02 | 91.4 | — | — | — | |
| ORGANICsnumber of units=128, number of parameters=100k2024.09 | 90.7 | — | — | — | |
| ORGANICsnumber of units=64, number of parameters=26k2024.09 | 89.9 | — | — | — | |
| stanhs=72016.02 | 88.9 | — | — | — | |
| stanhs=92016.02 | 88 | — | — | — | |
| LSTM2016.02 | 88 | — | — | — | |
| GRUParams.=70k2023.04 | 87.3 | — | — | — | |
| tanh RNN Architecture (4)k=9, s=k2016.02 | 86.9 | — | — | — | |
| LSTMParams.=70k2023.04 | 85.7 | — | — | — | |
| ORGANICs (fixed time constants)number of units=128, number of parameters=100k, time constants=fixed2024.09 | 84.8 | — | — | — | |
| stanhs=52016.02 | 84.3 | — | — | — | |
| iRNN2016.02 | 82 | — | — | — | |
| tanh RNN Architecture (4)k=5, s=k2016.02 | 81.2 | — | — | — | |
| ORGANICs (fixed time constants)number of units=64, number of parameters=26k, time constants=fixed2024.09 | 80.3 | — | — | — | |
| stanhs=32016.02 | 79.1 | — | — | — | |
| tanh RNN Architecture (3)k=9, s=k/22016.02 | 78.6 | — | — | — | |
| tanh RNN Architecture (3)k=5, s=k/22016.02 | 74.7 | — | — | — | |
| tanh RNN Architecture (2)k=9, s=12016.02 | 71.1 | — | — | — | |
| tanh RNN Architecture (2)k=5, s=12016.02 | 66.6 | — | — | — | |
| LSTMs=62016.02 | 65.9 | — | — | — | |
| LSTMs=52016.02 | 62.2 | — | — | — | |
| LSTMs=42016.02 | 60.8 | — | — | — | |
| tanh RNN Architecture (1)k=5, s=12016.02 | 55.5 | — | — | — | |
| tanh RNN Architecture (1)k=9, s=12016.02 | 55.5 | — | — | — | |
| stanhs=12016.02 | 49.8 | — | — | — | |
| RNN(tanh)2016.02 | 35 | — | — | — | |
| LSTMs=12016.02 | 28.5 | — | — | — | |
| LSTMs=32016.02 | 25 | — | — | — | |
| AntisymmetricStable RNN?=?, Params=36K2021.06 | — | — | 95.8 | — | |
| CKConvParams=1M2021.06 | — | — | 98.54 | — | |
| LSTMParams=68K2021.06 | — | — | 92.7 | — | |
| S4Params=7.9M2021.06 | — | — | 98.7 | — | |
| TransformerParams=0.5M2021.06 | — | — | 97.9 | — | |
| TrellisParams=8M2021.06 | — | — | 98.13 | — |