Continual Learning on MNIST Random-Label
95.5Average AccuracyPrune
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PruneCompactness=50%2026.05 | 95.5 | 19.6 | |
| PruneCompactness=40%2026.05 | 95.3 | 19.6 | |
| PruneCompactness=30%2026.05 | 95.1 | 19.6 | |
| PruneCompactness=20%2026.05 | 94.7 | 19.6 | |
| Grow+Rand. Smooth-LeakyCompactness=50%2026.05 | 85.9 | 19.6 | |
| Grow+Rand. Smooth-LeakyCompactness=40%2026.05 | 84.1 | 19.5 | |
| Grow+Rand. Smooth-LeakyCompactness=30%2026.05 | 83.4 | 19.5 | |
| Grow+Rand. Smooth-LeakyCompactness=20%2026.05 | 72.1 | 19.5 | |
| DenseCompactness=20%2026.05 | 39.2 | 16.8 | |
| DenseCompactness=30%2026.05 | 39.2 | 16.8 | |
| DenseCompactness=40%2026.05 | 39.2 | 16.8 | |
| DenseCompactness=50%2026.05 | 39.2 | 16.8 | |
| Grow+GradMaxCompactness=50%2026.05 | 24.3 | 13.6 | |
| Grow+Moment TransplantCompactness=50%2026.05 | 23.7 | 13.6 | |
| Grow+TwoSpeedCompactness=50%2026.05 | 23.6 | 13.6 | |
| GrowCompactness=50%2026.05 | 23.2 | 13.4 | |
| Grow+Moment TransplantCompactness=40%2026.05 | 22.4 | 14.4 | |
| Grow+GradMaxCompactness=40%2026.05 | 22.2 | 13.5 | |
| GrowCompactness=40%2026.05 | 21.1 | 13.4 | |
| Grow+TwoSpeedCompactness=40%2026.05 | 21 | 13.4 | |
| Grow+GradMaxCompactness=30%2026.05 | 20.6 | 13.5 | |
| Grow+Moment TransplantCompactness=30%2026.05 | 20.3 | 13.5 | |
| Grow+TwoSpeedCompactness=30%2026.05 | 20.1 | 13.3 | |
| GrowCompactness=30%2026.05 | 19.4 | 13.3 | |
| Grow+Net2WiderCompactness=50%2026.05 | 18.5 | 12.6 | |
| Grow+Moment TransplantCompactness=20%2026.05 | 17.7 | 13.7 | |
| Grow+Net2WiderCompactness=40%2026.05 | 17.5 | 12.7 | |
| Grow+Net2WiderCompactness=30%2026.05 | 16.5 | 12.7 | |
| GrowCompactness=20%2026.05 | 16.3 | 12.9 | |
| Grow+GradMaxCompactness=20%2026.05 | 16.2 | 12.9 | |
| Grow+TwoSpeedCompactness=20%2026.05 | 16.1 | 12.9 | |
| Grow+Net2WiderCompactness=20%2026.05 | 14.8 | 12.4 |