Sequential Image Classification on Sequential CIFAR10
91.13AccuracyS4
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| S42023.04 | 91.13 | — | — | — | — | |
| DSNParallel=true, Serial=true, Param.=0.519, Timestep=322026.02 | 90.1 | — | — | — | — | |
| PSNParallel=true, Serial=false, Param.=0.521, Timestep=322026.02 | 88.45 | — | — | — | — | |
| IPSUParallel=true, Serial=false, Param.=0.517, Timestep=322026.02 | 87.28 | — | — | — | — | |
| Sliding PSNParallel=true, Serial=true, Param.=0.514, Timestep=322026.02 | 86.7 | — | — | — | — | |
| SMPConvParams.=373k2023.04 | 84.86 | — | — | — | — | |
| LSSL2023.04 | 84.65 | — | — | — | — | |
| RPSUParallel=true, Serial=false, Param.=0.517, Timestep=322026.02 | 84.44 | — | — | — | — | |
| LIFParallel=false, Serial=true, Param.=0.513, Timestep=322026.02 | 81.5 | — | — | — | — | |
| PLIFParallel=false, Serial=true, Param.=0.513, Timestep=322026.02 | 81.5 | — | — | — | — | |
| FlexTCN-6Parameters=375K2021.10 | 80.82 | — | — | — | — | |
| FlexTCN MAGNet-6Parameters=375K2021.10 | 80.82 | — | — | — | — | |
| FlexTCNParams.=375k2023.04 | 80.82 | — | — | — | — | |
| FlexTCN-4Parameters=241K2021.10 | 80.26 | — | — | — | — | |
| FlexTCN-2Parameters=108K2021.10 | 78.99 | — | — | — | — | |
| FlexTCN Gabor-6Parameters=373K2021.10 | 78.36 | — | — | — | — | |
| FlexTCN Fourier-6Parameters=370K2021.10 | 74.79 | — | — | — | — | |
| CKTCN MAGNET-2Parameters=105K2021.10 | 74.58 | — | — | — | — | |
| URGRU + Zoneout2021.10 | 74.4 | — | — | — | — | |
| TrellisNetParameters=8M2021.10 | 73.42 | — | — | — | — | |
| TrellisNetParams.=8M2023.04 | 73.42 | — | — | — | — | |
| r-LSTMParameters=0.5M2021.10 | 72.2 | — | — | — | — | |
| r-LSTMParams.=500k2023.04 | 72.2 | — | — | — | — | |
| URLSTM2021.10 | 71 | — | — | — | — | |
| URLSTM2023.04 | 71 | — | — | — | — | |
| FlexTCN-6Parameters=375K2021.10 | 69.87 | — | — | — | — | |
| FlexTCN MAGNet-6Parameters=375K2021.10 | 69.87 | — | — | — | — | |
| CKTCN GABOR-2Parameters=106K2021.10 | 69.26 | — | — | — | — | |
| FlexTCN SIREN-6Parameters=343K2021.10 | 69.24 | — | — | — | — | |
| CKTCN FOURIER-2Parameters=105K2021.10 | 68.28 | — | — | — | — | |
| FlexTCN Gabor-6Parameters=373K2021.10 | 67.56 | — | — | — | — | |
| CKTCN MAGNET-2Parameters=105K2021.10 | 67.52 | — | — | — | — | |
| FlexTCN-4Parameters=241K2021.10 | 67.42 | — | — | — | — | |
| CKTCN GABOR-2Parameters=106K2021.10 | 67.37 | — | — | — | — | |
| FlexTCN Fourier-6Parameters=370K2021.10 | 67.35 | — | — | — | — | |
| FlexTCN-2Parameters=108K2021.10 | 67.11 | — | — | — | — | |
| CKTCN FOURIER-2Parameters=105K2021.10 | 66.26 | — | — | — | — | |
| LRUDepth (r)=1, State dimension (d)=322026.05 | 64.49 | — | — | — | — | |
| Lipschitz RNNParameters=158K2021.10 | 64.2 | — | — | — | — | |
| CKCNN-2-BigParameters=1M2021.10 | 63.74 | — | — | — | — | |
| UnICORNNParameters=135K2021.10 | 62.4 | — | — | — | — | |
| LRUDepth (r)=6, State dimension (d)=322026.05 | 62.34 | — | — | — | — | |
| CKCNN-2Parameters=98K2021.10 | 62.25 | — | — | — | — | |
| CKCNNParams.=98k2023.04 | 62.25 | — | — | — | — | |
| Self-Att.Parameters=0.5M2021.10 | 62.2 | — | — | — | — | |
| CKCNN-2-BigParameters=1M2021.10 | 62.2 | — | — | — | — | |
| MINGRUDepth (r)=6, State dimension (d)=322026.05 | 62.12 | — | — | — | — | |
| MINGRUDepth (r)=3, State dimension (d)=322026.05 | 60.95 | — | — | — | — | |
| CKCNN-2Parameters=98K2021.10 | 60.5 | — | — | — | — | |
| LRUDepth (r)=3, State dimension (d)=322026.05 | 59.99 | — | — | — | — | |
| CMRUDepth (r)=3, State dimension (d)=322026.05 | 59.82 | — | — | — | — | |
| αCMRUDepth (r)=6, State dimension (d)=322026.05 | 59.71 | — | — | — | — | |
| Lipschitz RNNParameters=158K2021.10 | 59 | — | — | — | — | |
| coRNNParameters=134K2021.10 | 59 | — | — | — | — | |
| CMRUDepth (r)=6, State dimension (d)=322026.05 | 58.81 | — | — | — | — | |
| MINGRUDepth (r)=1, State dimension (d)=322026.05 | 58.64 | — | — | — | — | |
| αCMRUDepth (r)=3, State dimension (d)=322026.05 | 58.64 | — | — | — | — | |
| FlexTCN SIREN-6Parameters=343K2021.10 | 57.27 | — | — | — | — | |
| CMRUDepth (r)=1, State dimension (d)=322026.05 | 56.27 | — | — | — | — | |
| αCMRUDepth (r)=1, State dimension (d)=322026.05 | 52.12 | — | — | — | — | |
| AntisymmetricStable RNN?=?, Params=36K2021.06 | — | — | — | 58.7 | — | |
| CKCNNNumber of Parameters=98K2021.02 | — | 62.25 | — | — | — | |
| CKCNN-BigNumber of Parameters=1M2021.02 | — | 63.74 | — | — | — | |
| CKConvParams=1M2021.06 | — | — | — | 63.74 | — | |
| FlexConv2022.06 | — | 80.82 | — | — | — | |
| HiPPO-RNN2022.06 | — | 61.1 | — | — | — | |
| LipschitzStable RNN?=true, Params=134K2021.06 | — | — | — | 64.2 | — | |
| LipschitzRNN2022.06 | — | 64.2 | — | — | — | |
| LSTMParams=68K2021.06 | — | — | — | 59.7 | — | |
| LSTM2022.06 | — | 63.01 | — | — | — | |
| r-LSTMNumber of Parameters=0.5M2021.02 | — | 72.2 | — | — | — | |
| r-LSTM2022.06 | — | 72.2 | — | — | — | |
| S4Params=7.9M2021.06 | — | — | — | 91.13 | — | |
| S4-(LegS/FouT)2022.06 | — | 91.58 | — | — | — | |
| S4-FouT2022.06 | — | 91.22 | — | — | — | |
| S4-LegS2022.06 | — | 91.8 | — | — | — | |
| S4D-Inv2022.06 | — | 90.69 | — | — | — | |
| S4D-LegS2022.06 | — | 89.92 | — | — | — | |
| S4D-Lin2022.06 | — | 90.42 | — | — | — | |
| Self-Att.Number of Parameters=0.5M2021.02 | — | 62.2 | — | — | — | |
| Sparse Combo NetStable RNN?=true, Params=130K2021.06 | — | 64.72 | 63.73 | 65.72 | 10 | |
| TransformerParams=0.5M2021.06 | — | — | — | 62.2 | — | |
| Transformer2022.06 | — | 62.2 | — | — | — | |
| TrellisParams=8M2021.06 | — | — | — | 73.42 | — | |
| TrellisNetNumber of Parameters=8M2021.02 | — | 73.42 | — | — | — | |
| TrellisNet2022.06 | — | 73.42 | — | — | — | |
| UR-GRU2022.06 | — | 74.4 | — | — | — |