Image Classification on MNIST (train) (Training Loss)
0Training LossDFC-SS
Evaluation Results
| Method | Links | |
|---|---|---|
| DFC-SS2021.06 | 0 | |
| DFC-SSA2021.06 | 0 | |
| DFC2021.06 | 0 | |
| BP2021.06 | 0 | |
| DFA2021.06 | 0 | |
| Evolved (APR)LR=Fixed, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| Random Reshuffle (RR)LR=Fixed, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| Shuffle Once (SO)LR=Fixed, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| Incremental Gradient (IG)LR=Fixed, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| DFC (fixed)2021.06 | 0 | |
| DFC-SS (fixed)2021.06 | 0 | |
| DFC-SSA (fixed)2021.06 | 0 | |
| Shuffle Once (SO)LR=Diminishing, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| Incremental Gradient (IG)LR=Diminishing, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| Evolved (APR)LR=Diminishing, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| Random Reshuffle (RR)LR=Diminishing, Optimizer=Adam, Epochs=1002026.03 | 0 | |
| AdamWweight decay=0.01, learning rate=10^−3, batch size=128, seeds=32026.05 | 0.0002 | |
| GONOlearning rate=10^−3, batch size=128, seeds=32026.05 | 0.0004 | |
| GGDNets=CNN_3, Structures=3*(3*3)+128,102026.02 | 0.0034 | |
| AdamNets=CNN_3, Structures=3*(3*3)+128,102026.02 | 0.0075 | |
| GGDNets=CNN_2, Structures=3*(3*3)+102026.02 | 0.0116 | |
| AdamNets=CNN_2, Structures=3*(3*3)+102026.02 | 0.0132 | |
| GGDNets=CNN_1, Structures=2*(3*3)+102026.02 | 0.0136 | |
| AdamNets=CNN_1, Structures=2*(3*3)+102026.02 | 0.0174 | |
| MuonNets=CNN_3, Structures=3*(3*3)+128,102026.02 | 0.019 | |
| MuonNets=CNN_2, Structures=3*(3*3)+102026.02 | 0.0232 | |
| MuonNets=CNN_1, Structures=2*(3*3)+102026.02 | 0.0394 | |
| FldzhyanMesh=784x784, Epochs=150, Batch Size=512, Learning Rate=0.0000382025.12 | 0.0588 | |
| Fldzhyan BellMesh=784x784, Epochs=150, Batch Size=512, Learning Rate=0.0000382025.12 | 0.0634 | |
| Adamlearning rate=10^−3, batch size=128, seeds=32026.05 | 0.067 | |
| SGDMNets=CNN_1, Structures=2*(3*3)+102026.02 | 0.0672 | |
| SGDMNets=CNN_3, Structures=3*(3*3)+128,102026.02 | 0.0805 | |
| Clements BellMesh=784x784, Epochs=150, Batch Size=512, Learning Rate=0.0000382025.12 | 0.0851 | |
| SGDMNets=CNN_2, Structures=3*(3*3)+102026.02 | 0.0856 | |
| ClementsMesh=784x784, Epochs=150, Batch Size=512, Learning Rate=0.0000382025.12 | 0.1026 | |
| SGDNets=CNN_1, Structures=2*(3*3)+102026.02 | 0.196 | |
| SGDNets=CNN_2, Structures=3*(3*3)+102026.02 | 0.293 | |
| SGDNets=CNN_3, Structures=3*(3*3)+128,102026.02 | 0.35 | |
| SSGDNets=CNN_1, Structures=2*(3*3)+102026.02 | 0.789 | |
| SSGDNets=CNN_2, Structures=3*(3*3)+102026.02 | 1.91 | |
| SSGDNets=CNN_3, Structures=3*(3*3)+128,102026.02 | 2.18 |