Epsilon-stationary point finding on Non-convex Stochastic Optimization Average Smoothness Assumption
1Convergence RateAdaFom
Evaluation results
| Method | Links | |
|---|---|---|
| AdaFomLipschitz Free=✘, 1st Moment Estimate (αt)=Const, 2nd Moment Estimate (βt)=Open, Stepsize (γt)=Open, Additional Assumptions=BG2026.03 | 1 | |
| Practical AdamLipschitz Free=✘, 1st Moment Estimate (αt)=Open, 2nd Moment Estimate (βt)=Const, Stepsize (γt)=Open, Additional Assumptions=BG, αt > β22026.03 | 1 | |
| SuperADAM-ALipschitz Free=✘, 1st Moment Estimate (αt)=Const, 2nd Moment Estimate (βt)=—, Stepsize (γt)=Open, Additional Assumptions=BH2026.03 | 1 | |
| Vanilla AdamLipschitz Free=✘, 1st Moment Estimate (αt)=Open, 2nd Moment Estimate (βt)=Const, Stepsize (γt)=Open, Additional Assumptions=BG, αt ≤ √β2026.03 | 1 | |
| AdaGrad-NormLipschitz Free=✔, 1st Moment Estimate (αt)=—, 2nd Moment Estimate (βt)=—, Stepsize (γt)=Ada, Additional Assumptions=BG2026.03 | 1 | |
| OptEMA-MLipschitz Free=✔, 1st Moment Estimate (αt)=Ada, 2nd Moment Estimate (βt)=Const, Stepsize (γt)=Ada, Additional Assumptions=—2026.03 | 1 | |
| OptEMA-VLipschitz Free=✔, 1st Moment Estimate (αt)=Const, 2nd Moment Estimate (βt)=Ada, Stepsize (γt)=Ada, Additional Assumptions=—2026.03 | 1 |