Automatic Speech Recognition on LibriSpeech (val)
6.5WER (Validation)DR-Shampoo
Evaluation results
| Method | Links | |
|---|---|---|
| DR-ShampooHyperparameters (f, τ, ε₀, εmax)=(50, 0.4, 10⁻⁹, N/A), Wall-clock Time=294 (minute)2026.06 | 6.5 | |
| FOAMHyperparameters (f, τ, ε₀, εmax)=(50, 0.4, 10⁻⁹, 3 × 10⁻⁷), Wall-clock Time=257 (minute)2026.06 | 6.5 | |
| SOAPHyperparameters (f, τ, ε₀, εmax)=(50, N/A, 10⁻⁹, N/A), Wall-clock Time=265 (minute)2026.06 | 6.7 | |
| stale ShampooHyperparameters (f, τ, ε₀, εmax)=(50, N/A, 10⁻⁹, N/A), Wall-clock Time=264 (minute)2026.06 | 6.9 | |
| AdamWHyperparameters (f, τ, ε₀, εmax)=(N/A, N/A, 10⁻⁹, N/A), Wall-clock Time=205 (minute)2026.06 | 9.9 |