Continual Learning on MNIST Shuffled Labels
97.6Accuracy (ACC)FTN-Slow
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FTN-Slowevaluation_protocol=mask-recovery eval protocol, number_of_seeds=8, tasks=52026.04 | 97.6 | 0.4 | 0.4 | |
| KWTAevaluation_protocol=mask-recovery eval protocol, number_of_seeds=8, tasks=52026.04 | 95.1 | 2.5 | 2.3 | |
| FTN-Fastevaluation_protocol=mask-recovery eval protocol, number_of_seeds=8, tasks=52026.04 | 93.8 | 5.2 | 5.2 | |
| Rand. Smooth-LeakyActivation=Rand. Smooth-Leaky2025.09 | 93.33 | — | — | |
| RReLUActivation=RReLU2025.09 | 93.1 | — | — | |
| PReLUActivation=PReLU2025.09 | 92.67 | — | — | |
| Deep FourierActivation=Deep Fourier2025.09 | 92.61 | — | — | |
| RationalActivation=Rational2025.09 | 92.35 | — | — | |
| Smooth-LeakyActivation=Smooth-Leaky2025.09 | 91.69 | — | — | |
| Leaky-ReLUActivation=Leaky-ReLU2025.09 | 91.53 | — | — | |
| CReLUActivation=CReLU2025.09 | 89.47 | — | — | |
| eLUActivation=eLU2025.09 | 84.23 | — | — | |
| SeLUActivation=SeLU2025.09 | 79.95 | — | — | |
| SigmoidActivation=Sigmoid2025.09 | 79.59 | — | — | |
| Swish (SiLU)Activation=Swish (SiLU)2025.09 | 67.73 | — | — | |
| TanhActivation=Tanh2025.09 | 63.4 | — | — | |
| GeLUActivation=GeLU2025.09 | 38.79 | — | — | |
| CeLUActivation=CeLU2025.09 | 37.16 | — | — | |
| SwiGLUActivation=SwiGLU2025.09 | 31.2 | — | — | |
| NoMaskevaluation_protocol=mask-recovery eval protocol, number_of_seeds=8, tasks=52026.04 | 25.5 | 90.4 | 90.4 | |
| EWCevaluation_protocol=mask-recovery eval protocol, number_of_seeds=8, tasks=52026.04 | 25.5 | 90.3 | 90.3 | |
| ReLUActivation=ReLU2025.09 | 20.03 | — | — |