WikiText-103
Benchmarks
TaskDatasetSOTA resultTrendResults
WikiText-103
87Mauve
18
WikiText-103
173.704Base Score
18
WikiText-103
15.33Perplexity
17
WikiText-103
72Perplexity (PPL)
15
WikiText-103
0.391ROUGE-1
15
WikiText-103
24Quality Better Count
14
WikiText-103
0.784AUC
14
WikiText-103 byte-level (val)
1.796Loss (Context 8192)
13
WikiText-103 (val)
0.388Partial Correlation (rho)
13
WikiText-103 (test)
0.782AUC
13
WikiText-103 50w x 2048 (test)
7.59Perplexity
12
WikiText-103 finetuned
100Memory Efficiency @ 50%
12
WikiText-103
15.52PPLmed
11
WikiText-103 (fine-tuning)
12.4Training Time (s)
11
Wikitext-103 v1
98.7Diversity
11
WikiText-103 Medium (test)
35.37Perplexity (PPL)
10
WikiText-103 Medium (val)
33.76Perplexity (PPL)
10
WikiText-103
5.29Perplexity (PPL)
10
WikiText-103
3.156Loss
10
Wikitext-103
2.55PPL
10
WikiText-103
8.53Perplexity
9
WikiText-103
24.1WT-103 Delta (%)
9
WikiText-103
446.8Perplexity (PPL)
9
Wikitext-103 v1
0.627Cosine Similarity
9
Wikitext-103
18.5PPL
9