Text8
Benchmarks
TaskDatasetSOTA resultTrendResults
text8 (test)
1.038BPC
128
Text8 (test)
1.23BPC
35
text8
1.02BPC
23
Text8 word-level (test)
99.9Perplexity
19
Text8 word-level (val)
81.64Perplexity
18
text8
0.98BPC
16
Text8 (val)
0.931Validation Loss
15
text8 (held-out 1M tokens)
2.3BPC
14
text8 (dev)
1.01BPC
13
text8 English (test)
1.133BPC
8
text8 (most recent 1M tokens)
2.23BPC
7
text8 100M regime Backward stream
2.17Backward BPC
7
text8 100M regime (Current stream split)
2.12Current BPC
7
text8 100M regime (Forward split)
2.19Forward BPC
7
text8
1.45BPC
2
text8 unconditional
—Primary metric
0