Non-convex Optimization on Finite-sum Exact Full-Gradient Initialization
0Oracle ComplexityGD
Evaluation Results
| Method | Links | |
|---|---|---|
| GDComplexity Form=General (tunable) form, Note=No tuning2026.06 | 0 | |
| SILVERComplexity Form=General (tunable) form2026.06 | 0 | |
| SILVERComplexity Form=Specialization, Canonical batch-size choice=𝑏sv = 12026.06 | 0 | |
| PAGEComplexity Form=Specialization, Regime=𝑚 ≥ 𝑛, Canonical batch-size choice=𝑏fp = 𝑛2026.06 | 0 | |
| PAGEComplexity Form=Specialization, Regime=𝑛 > 𝑚, Canonical batch-size choice=𝑏fp = 𝑚2026.06 | 0 | |
| ZeroSARAHComplexity Form=Specialization, Canonical batch-size choice=𝑏zs = √𝑛𝑚 and 𝜆 = 𝑏zs/(2𝑛𝑚)2026.06 | 0 | |
| D-ZeroSARAHComplexity Form=Specialization, Canonical batch-size choice=𝑠dzs = √𝑛, 𝑏dzs = √𝑚, and 𝜆 = 𝑠dzs 𝑏dzs/(2𝑛𝑚)2026.06 | 0 | |
| PAGEComplexity Form=General (tunable) form2026.06 | 1 | |
| D-PAGEComplexity Form=Specialization, Regime=𝑛 > 𝑚, Canonical batch-size choice=𝑠dp = 𝑚, 𝑏dp = 12026.06 | 1 | |
| ZeroSARAHComplexity Form=General (tunable) form2026.06 | 1 | |
| D-ZeroSARAHComplexity Form=General (tunable) form2026.06 | 1 | |
| SILAGE (𝑛 > 𝑚)Complexity Form=Specialization, Regime=𝑛 > 𝑚, Canonical batch-size choice=𝑏grp = 𝑚2026.06 | 1 | |
| D-PAGEComplexity Form=General (tunable) form2026.06 | 2 | |
| D-PAGEComplexity Form=Specialization, Regime=𝑚 ≥ 𝑛, Canonical batch-size choice=𝑠dp = 𝑛, 𝑏dp = 12026.06 | 2 | |
| SILAGE (𝑚 ≥ 𝑛)Complexity Form=General (tunable) form, Regime=𝑚 ≥ 𝑛, Note=No batch-size/client-size tuning in this regime2026.06 | 2 | |
| SILAGE (𝑛 > 𝑚)Complexity Form=General (tunable) form, Regime=𝑛 > 𝑚2026.06 | 2 |