Character-level language modeling on Shakespeare (test)
50.2AccuracyAdam
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AdamArchitecture=4 x 128 + Skip2025.06 | 50.2 | 15,800 | 75.1 | 4.75 | |
| AdamArchitecture=1 x 2562025.06 | 49.9 | 7,400 | 20 | 2.7 | |
| AdamArchitecture=4 x 1282025.06 | 49.8 | 28,600 | 118.4 | 4.14 | |
| SGDArchitecture=4 x 128 + Skip2025.06 | 38.9 | 129,600 | 619.7 | 4.78 | |
| SGDArchitecture=1 x 2562025.06 | 35.7 | 179,000 | 480.9 | 2.69 | |
| SGDArchitecture=4 x 1282025.06 | 35.1 | 63,000 | 255.3 | 4.05 | |
| DRArchitecture=1 x 2562025.06 | 32.4 | 16,600 | 849 | 51.14 | |
| DRArchitecture=4 x 128 + Skip2025.06 | 32.2 | 32,800 | 1,210.8 | 36.91 | |
| APArchitecture=4 x 128 + Skip2025.06 | 30.2 | 205,200 | 2,964.4 | 14.44 | |
| APArchitecture=1 x 2562025.06 | 29.6 | 98,800 | 1,646 | 16.66 | |
| DRArchitecture=4 x 1282025.06 | 26.7 | 10,400 | 234.1 | 22.51 | |
| APArchitecture=4 x 1282025.06 | 26.5 | 182,400 | 1,688.6 | 9.26 |