List your company
ResearchFormerly WizWand

Continual Supervised Learning on CIFAR 5+1

74.9Total Average Online Task AccuracyPrune
-1.134418.605338.34558.0847Sep 26, 2025Nov 3, 2025Dec 11, 2025Jan 19, 2026Feb 26, 2026Apr 5, 2026May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
PruneCompactness=50%2026.0574.924.1
PruneCompactness=40%2026.0574.824.4
PruneCompactness=30%2026.057424.1
PruneCompactness=20%2026.0573.124.1
Deep FourierActivation=Deep Fourier2025.0972.29—
Grow+Rand. Smooth-LeakyCompactness=50%2026.0567.922.6
Grow+Rand. Smooth-LeakyCompactness=30%2026.0565.322.1
Grow+Rand. Smooth-LeakyCompactness=40%2026.056522.4
Grow+Rand. Smooth-LeakyCompactness=20%2026.0563.621.6
Rand. Smooth-LeakyActivation=Rand. Smooth-Leaky2025.0957.01—
CeLUActivation=CeLU2025.0954.23—
RReLUActivation=RReLU2025.0953.6—
Smooth-LeakyActivation=Smooth-Leaky2025.0949.87—
SeLUActivation=SeLU2025.0949.07—
Leaky-ReLUActivation=Leaky-ReLU2025.0948.86—
eLUActivation=eLU2025.0947.64—
PReLUActivation=PReLU2025.0943.3—
RationalActivation=Rational2025.0940.41—
Grow+Moment TransplantCompactness=40%2026.0538.318.2
Swish (SiLU)Activation=Swish (SiLU)2025.0935.31—
Grow+Moment TransplantCompactness=30%2026.0535.117.5
GrowCompactness=50%2026.0534.417.7
GrowCompactness=40%2026.0533.818.8
Grow+GradMaxCompactness=50%2026.0533.718.4
Grow+GradMaxCompactness=30%2026.0531.817.7
Grow+Net2WiderCompactness=40%2026.0531.816.9
Grow+Moment TransplantCompactness=50%2026.0531.613.3
Grow+Net2WiderCompactness=50%2026.0530.917.2
Grow+Net2WiderCompactness=30%2026.0530.618
Grow+TwoSpeedCompactness=40%2026.0530.217.7
Grow+GradMaxCompactness=40%2026.053017
GrowCompactness=30%2026.0529.417.7
Grow+TwoSpeedCompactness=50%2026.0529.312.5
TanhActivation=Tanh2025.0928.59—
Grow+TwoSpeedCompactness=30%2026.0528.317.3
Grow+Moment TransplantCompactness=20%2026.052518.1
Grow+GradMaxCompactness=20%2026.0524.416.4
GrowCompactness=20%2026.0523.716.9
Grow+Net2WiderCompactness=20%2026.052317.1
Grow+TwoSpeedCompactness=20%2026.0520.816.4
CReLUActivation=CReLU2025.0920.56—
GeLUActivation=GeLU2025.0917.6—
DenseCompactness=20%2026.0513.826.1
DenseCompactness=30%2026.0513.826.1
DenseCompactness=40%2026.0513.826.1
DenseCompactness=50%2026.0513.826.1
SwiGLUActivation=SwiGLU2025.099.57—
ReLUActivation=ReLU2025.094.76—
SigmoidActivation=Sigmoid2025.091.79—