Autoencoder Training on Autoencoder (train)
50.702Train CE LossShampoo(20)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Shampoo(20)Precision=float32, Method Order=Second Order2023.11 | 50.702 | 371 | |
| band-4-SONewPrecision=float32, Method Order=Second Order2023.11 | 51.357 | 260 | |
| Shampoo(20)Precision=bfloat16, Method Order=Second Order2023.11 | 51.401 | 1,245 | |
| tridiag-SONewPrecision=float32, Method Order=Second Order2023.11 | 51.723 | 70 | |
| band-4-SONewPrecision=bfloat16, Method Order=Second Order2023.11 | 51.84 | 230 | |
| tridiag-SONewPrecision=bfloat16, Method Order=Second Order2023.11 | 51.937 | 55 | |
| rfdSON(4)Precision=float32, Method Order=Second Order2023.11 | 52.97 | 300 | |
| diag-SONewPrecision=float32, Method Order=First Order2023.11 | 53.025 | 63 | |
| diag-SONewPrecision=bfloat16, Method Order=First Order2023.11 | 53.29 | 44 | |
| RMSPropPrecision=float32, Method Order=First Order2023.11 | 53.33 | 62 | |
| rfdSON(1)Precision=float32, Method Order=Second Order2023.11 | 53.56 | 85 | |
| AdamPrecision=float32, Method Order=First Order2023.11 | 53.591 | 62 | |
| RMSPropPrecision=bfloat16, Method Order=First Order2023.11 | 53.743 | 37 | |
| AdamPrecision=bfloat16, Method Order=First Order2023.11 | 54.328 | 38 | |
| AdagradPrecision=float32, Method Order=First Order2023.11 | 54.393 | 62 | |
| rfdSON(4)Precision=bfloat16, Method Order=Second Order2023.11 | 55.53 | 284 | |
| rfdSON(1)Precision=bfloat16, Method Order=Second Order2023.11 | 57.42 | 80 | |
| MomentumPrecision=float32, Method Order=First Order2023.11 | 58.651 | 67 | |
| NesterovPrecision=float32, Method Order=First Order2023.11 | 59.087 | 102 | |
| SGDPrecision=float32, Method Order=First Order2023.11 | 67.654 | 62 | |
| AdagradPrecision=bfloat16, Method Order=First Order2023.11 | 68.854 | 37 | |
| MomentumPrecision=bfloat16, Method Order=First Order2023.11 | 70.053 | 36 | |
| NesterovPrecision=bfloat16, Method Order=First Order2023.11 | 72.975 | 43 | |
| SGDPrecision=bfloat16, Method Order=First Order2023.11 | 80.454 | 36 |