WikiText2
Benchmarks
TaskDatasetSOTA resultTrendResults
WikiText2
2.73Perplexity
4,085
Wikitext2
2.58Perplexity
447
WikiText2 (val)
3.03Perplexity (PPL)
436
WikiText2 v1 (test)
1.7Perplexity
396
WikiText2
2.9Perplexity
287
WikiText2 2016 (test)
3.32Perplexity
88
WikiText2 (train)
5.307Final Train Loss
16
WikiText2 zero-shot
26.06Perplexity
13
Wikitext2
7.64Perplexity
12
WikiText2
97.54TRA
7
WikiText2 (test)
531.97Avg PPL
3