Pile
Benchmarks
TaskDatasetSOTA resultTrendResults
Pile CC
1.7TPR @ 1%
61
Pile CC Pythia
71ROC AUC
36
Pile
11.2Perplexity
18
MiniPile (val)
40.83Validation Perplexity
10
MiniPile (train)
30.87Training Perplexity
10
Pile single-view, random camera pose, Gaussian noise
92GSR
10
Pile uncopyrighted (test)
3.608Worst Log-Perplexity
9
Pile
1.876Loss
8
Pile Real-world
79.3GSR (%)
7
PILE
50.9Loss (AUROC)
7
PILE (train)
8.2Loss
7
Minipile (pretraining)
17.32Perplexity
6
Pile 17 domains 1.0 (train test)
1.533MRE (%)
6
Pile (val)
1.808Loss
5
Pile
0.74BPB
4
Pile (test)
59.4Accuracy
3
pile
1.65PPL
3
Pile Non-AR tokens
33.95Perplexity
3
Pile AR tokens
3.07Perplexity
3
pile (val)
12.978Perplexity
2