Autoencoder on Autoencoder (Training Evaluation)
51.401Train CE LossShampoo(20)
Evaluation Results
| Method | Links | |
|---|---|---|
| Shampoo(20)Precision=bfloat16, Train time(s)=1245, Optimizer Category=Second Order Methods2023.11 | 51.401 | |
| band-4-SONewPrecision=bfloat16, Train time(s)=230, Optimizer Category=Second Order Methods2023.11 | 51.84 | |
| tridiag-SONewPrecision=bfloat16, Train time(s)=55, Optimizer Category=Second Order Methods2023.11 | 51.937 | |
| diag-SONewPrecision=bfloat16, Train time(s)=44, Optimizer Category=First Order Methods2023.11 | 53.29 | |
| RMSPropPrecision=bfloat16, Train time(s)=37, Optimizer Category=First Order Methods2023.11 | 53.743 | |
| AdamPrecision=bfloat16, Train time(s)=38, Optimizer Category=First Order Methods2023.11 | 54.328 | |
| rfdSON(4)Precision=bfloat16, Train time(s)=284, Optimizer Category=Second Order Methods2023.11 | 55.53 | |
| rfdSON(1)Precision=bfloat16, Train time(s)=80, Optimizer Category=Second Order Methods2023.11 | 57.42 | |
| AdagradPrecision=bfloat16, Train time(s)=37, Optimizer Category=First Order Methods2023.11 | 68.854 | |
| MomentumPrecision=bfloat16, Train time(s)=36, Optimizer Category=First Order Methods2023.11 | 70.053 | |
| NesterovPrecision=bfloat16, Train time(s)=43, Optimizer Category=First Order Methods2023.11 | 72.975 | |
| SGDPrecision=bfloat16, Train time(s)=36, Optimizer Category=First Order Methods2023.11 | 80.454 |