WikiText-103
Benchmarks
TaskDatasetSOTA resultTrendResults
WikiText-103 (test)
7.88Tail-patch Score
9
WikiText-103 5.0% corruption (test)
43.511Perplexity (PPL)
8
WikiText-103 2.5% corruption (test)
33.008Perplexity (PPL)
8
WikiText-103 1.5% corruption (test)
29.339Perplexity (PPL)
8
WikiText-103
18.33LDS
8
WikiText-103
6.88PPL
8
WikiText-103 (test)
13.96MAUVE
8
WikiText-103 (test)
23.82PPL
8
Wikitext-103 (test)
84Win Rate
8
Wikitext-103
18.31Perplexity
8
WikiText-103 v1 (val)
2.29Training Loss
7
WikiText-103 (retention)
16.29Perplexity
7
WikiText-103 1024 (test)
19PPL
7
WikiText-103 Phi-3.5-mini
6.292PPL
6
WikiText-103 (train)
2.422Training Loss
6
WikiText-103 raw-v1 (test)
2.587Loss
6
WikiText-103 GPT-2 (124M) (train)
4.461Train Loss
6
WikiText-103 GPT-2 (124M) (val)
72.57Validation Perplexity
6
WikiText-103 (train)
6.619Training Loss
6
WikiText-103 (val)
6.676Validation Loss
6
WikiText-103
20.51Perplexity (PPL)
5
WikiText-103
14.6Latency (ms/token)
5
WikiText-103
21Contracting Ratio
5
WikiText-103
115Speedup Ratio (GPU-O vs CPU-BPE)
5
WikiText-103 contaminated (test)
47.61Perplexity (PPL)
4