Autoencoding on MNIST (train)
50.702Train CE LossShampoo
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ShampooOrder=Second Order, Precision=float32, Preconditioner Update Interval=202023.11 | 50.702 | 371 | |
| band-4-SONewOrder=Second Order, Precision=float32, Sparsity=banded (k=4)2023.11 | 51.357 | 260 | |
| tridiag-SONewOrder=Second Order, Precision=float32, Sparsity=tridiagonal2023.11 | 51.723 | 70 | |
| diag-SONewOrder=First Order, Precision=float32, Sparsity=diagonal2023.11 | 53.025 | 63 | |
| RMSPropOrder=First Order, Precision=float322023.11 | 53.33 | 62 | |
| AdamOrder=First Order, Precision=float322023.11 | 53.591 | 62 | |
| AdagradOrder=First Order, Precision=float322023.11 | 54.393 | 62 | |
| rfdSONOrder=Second Order, Precision=float32, Rank=42023.11 | 55.55 | 300 | |
| rfdSONOrder=Second Order, Precision=float32, Rank=12023.11 | 56.21 | 85 |