Language Modeling
Benchmarks
TaskDatasetSOTA resultTrendResults
Language Modeling
8.005Perplexity
26
Language Modeling Evaluation
1.71Perplexity (PPL)
26
Language Modeling Average
5.67PPL
12
Language Modeling (test)
33.19PPL (64)
10
Language Modeling PII-annotated (train)
21.5TPR @ 0.1% FPR
9
Language Modeling (LM)
2.69CE (128-255 tokens)
7