WikiText-103
Benchmarks
TaskDatasetSOTA resultTrendResults
WikiText-103 (test)
2.22Perplexity
773
WikiText-103 (val)
1.01PPL
290
WikiText-103
4.59PPL
216
WikiText-103 word-level (test)
15.79Perplexity
65
WikiText-103 (dev)
15.72Perplexity
64
WikiText-103 v1 (test)
10.48Perplexity
56
WikiText-103 512-token continuation (test)
1Perplexity (PPL)
47
WikiText-103
5.47Perplexity (PPL)
43
Wikitext-103
3.14PPL
42
WikiText-103
1Perplexity (PPL)
41
WikiText-103 (dev)
17.9Perplexity
40
WikiText-103 zero-shot (test)
12.76PPL
34
WikiText-103 clean (test)
23.32Perplexity
30
Wikitext-103
14.8Perplexity (PPL)
28
Wikitext-103 (test)
0.96MAUVE
26
WikiText-103
1.92Latency (ms)
25
WikiText-103
0Delta PPL
25
WikiText-103 word-level (val)
7.533Perplexity
25
Wikitext-103
32.88Perplexity
23
WikiText-103 Attacked (test)
41.351Perplexity (PPL)
21
WikiText-103 Attacked (val)
39.677Perplexity
21
WikiText-103 W (test)
75Accuracy
20
WikiText-103 small setting (test)
32.8Perplexity
20
WikiText-103 small setting (val)
31.8Perplexity
20
WikiText-103 (train)
15.18PPL
19