Matrix Factorization on Exponential learning rate scheduling
1MaxSETrivial factorization Aχ × I
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Trivial factorization Aχ × IFactorization=(b) Aχ = Aχ × I2025.11 | 1 | 1 | |
| Square-root factorizationFactorization=(d) Aχ = Aχ^(1/2) × Aχ^(1/2)2025.11 | 1 | 1 | |
| Learning-rate-aware factorizationFactorization=(e) Aχ = Aχ(Aχ^Toep)^(−1/2) × (Aχ^Toep)^(1/2)2025.11 | 1 | 1 | |
| Prefix-sum-based factorizationFactorization=(f) Aχ = A1DA1^(−1/2) × A1^(1/2)2025.11 | 1 | 1 | |
| Lower BoundFactorization=N/A2025.11 | 1 | 1 |