The Pile
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
The Pile FreeLaw (test)
71.63BPB (%)
6
The Pile DM Math (test)
82.14BPB (%)
6
The Pile ArXiv (test)
88.57BPB Score
6
The Pile (test)
54.2MAP
6
The Pile GitHub subset
1P-Value (Members)
5
The Pile
1,200Raw KL Divergence
5
The Pile (ID) Twitter (OOD) (test)
99.22AUROC
5
The Pile EDGAR Reports ID OOD (test)
68.09AUROC
5
The Pile ID 4Chan OOD (test)
87.97AUROC
5
The Pile Gemma-2-2B (test)
0.962KL Score
4
The Pile (All Subsets)
1P-Value (Members)
4
The Pile (test)
0.54Coverage
4
The Pile Ubuntu
3.01P-Value
2
The Pile GitHub
3.65P-Value
2
The Pile CC
2.18P-Value
2
The Pile PubMed Central (test)
7.25PPL
2