Character-level language modeling on Shakespeare (train)
59.8AccuracyAdam
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AdamArchitecture=1 x 2562025.06 | 59.8 | 7.4 | 20 | 2.7 | |
| AdamArchitecture=4 x 128 + Skip2025.06 | 59 | 15.8 | 75.1 | 4.75 | |
| AdamArchitecture=4 x 1282025.06 | 57.9 | 28.6 | 118.4 | 4.14 | |
| SGDArchitecture=4 x 128 + Skip2025.06 | 42.6 | 129.6 | 619.7 | 4.78 | |
| SGDArchitecture=1 x 2562025.06 | 38.8 | 179 | 480.9 | 2.69 | |
| SGDArchitecture=4 x 1282025.06 | 37.1 | 63 | 255.3 | 4.05 | |
| DRArchitecture=1 x 2562025.06 | 34 | 16.6 | 849 | 51.14 | |
| DRArchitecture=4 x 128 + Skip2025.06 | 33.9 | 32.8 | 1,210.8 | 36.91 | |
| APArchitecture=4 x 128 + Skip2025.06 | 31.1 | 205.2 | 2,964.4 | 14.44 | |
| APArchitecture=1 x 2562025.06 | 30.4 | 98.8 | 1,646 | 16.66 | |
| DRArchitecture=4 x 1282025.06 | 27.4 | 10.4 | 234.1 | 22.51 | |
| APArchitecture=4 x 1282025.06 | 27.1 | 182.4 | 1,688.6 | 9.26 |