List your company
ResearchFormerly WizWand

Continual Supervised Learning on CIFAR Random Label

98.42Total Average Online Task AccuracyRand. Smooth-Leaky
9.687232.723655.7678.7964Sep 26, 2025Nov 3, 2025Dec 11, 2025Jan 19, 2026Feb 26, 2026Apr 5, 2026May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Rand. Smooth-LeakyActivation=Rand. Smooth-Leaky2025.0998.42—
Smooth-LeakyActivation=Smooth-Leaky2025.0998.36—
Leaky-ReLUActivation=Leaky-ReLU2025.0998.34—
RReLUActivation=RReLU2025.0998.02—
PruneCompactness=50%2026.0597.919.6
PruneCompactness=40%2026.0597.819.6
PruneCompactness=20%2026.0597.619.6
PruneCompactness=30%2026.0597.619.6
Grow+Rand. Smooth-LeakyCompactness=50%2026.0597.119.6
PReLUActivation=PReLU2025.0996.86—
Grow+Rand. Smooth-LeakyCompactness=40%2026.0596.819.6
Deep FourierActivation=Deep Fourier2025.0996.24—
Grow+Rand. Smooth-LeakyCompactness=30%2026.0596.119.6
RationalActivation=Rational2025.0994.82—
Grow+Rand. Smooth-LeakyCompactness=20%2026.0594.419.6
CReLUActivation=CReLU2025.0992.9—
Swish (SiLU)Activation=Swish (SiLU)2025.0987.4—
SeLUActivation=SeLU2025.0984.61—
SwiGLUActivation=SwiGLU2025.0983.06—
TanhActivation=Tanh2025.0958.56—
eLUActivation=eLU2025.0957.45—
SigmoidActivation=Sigmoid2025.0952.24—
DenseCompactness=20%2026.0546.317.3
DenseCompactness=30%2026.0546.317.3
DenseCompactness=40%2026.0546.317.3
DenseCompactness=50%2026.0546.317.3
GeLUActivation=GeLU2025.0942.85—
CeLUActivation=CeLU2025.0929.64—
ReLUActivation=ReLU2025.0925.79—
Grow+Moment TransplantCompactness=30%2026.0519.513.9
Grow+Net2WiderCompactness=40%2026.051813.4
Grow+Moment TransplantCompactness=40%2026.0517.413.6
Grow+Moment TransplantCompactness=50%2026.0517.313.6
Grow+TwoSpeedCompactness=50%2026.0515.813
Grow+TwoSpeedCompactness=30%2026.0515.412.9
GrowCompactness=50%2026.0515.413
Grow+Moment TransplantCompactness=20%2026.0515.213.4
Grow+Net2WiderCompactness=30%2026.0515.112.9
GrowCompactness=30%2026.0514.912.8
Grow+Net2WiderCompactness=50%2026.0514.812.7
Grow+TwoSpeedCompactness=40%2026.0514.612.9
GrowCompactness=40%2026.0514.112.8
Grow+GradMaxCompactness=30%2026.0513.912.7
Grow+TwoSpeedCompactness=20%2026.0513.812.8
Grow+GradMaxCompactness=50%2026.0513.812.7
Grow+GradMaxCompactness=20%2026.0513.712.6
Grow+GradMaxCompactness=40%2026.0513.612.5
GrowCompactness=20%2026.0513.512.8
Grow+Net2WiderCompactness=20%2026.0513.112.5