Streaming Image Classification on EMNIST label-permuted 5M interactions 2000 tasks (streaming)
80.7Average Online AccuracyFADE + SGD
Evaluation results
| Method | Links | |
|---|---|---|
| FADE + SGDLayer Scope=Head-only2026.04 | 80.7 | |
| FADE + AdamLayer Scope=Head-only2026.04 | 75 | |
| SGD + WClip2026.04 | 61.2 | |
| AdamW2026.04 | 37.2 | |
| SGD + WD2026.04 | 33.5 | |
| SGD2026.04 | 25.8 | |
| Adam2026.04 | 11.9 | |
| FADEbase optimizer=SGD2026.04 | 0.841 | |
| FADEbase optimizer=Adam2026.04 | 0.808 | |
| SGD2026.04 | 0.735 | |
| SGDRegularization=Weight Clipping (WClip)2026.04 | 0.719 | |
| SGDRegularization=Weight Decay (WD)2026.04 | 0.694 | |
| AdamW2026.04 | 0.541 | |
| Adam2026.04 | 0.448 |