List your company

Non-linear tracking on Non-linear teacher-student tracking (final 500K steps)

0.0073MSEFADE + SGD
0.0069120.0095310.012150.014769Apr 29, 2026

Evaluation results

MethodLinks
FADE + SGDBase Optimizer=SGD2026.040.0073
FADE + AdamBase Optimizer=Adam2026.040.0087
AdamW2026.040.0138
SGD + WDWeight Decay=True2026.040.0167
SGD2026.040.0168
Adam2026.040.017