Next-token prediction
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
42.33Next Token Accuracy
40
Apr 10, 2026
47Next Token Accuracy
32
Feb 26, 2026
51Next Token Accuracy
32
Feb 26, 2026
40.05Next Token Accuracy
32
Feb 26, 2026
18.68PPL
30
Apr 1, 2026
21.5Perplexity (PPL)
30
Apr 1, 2026
21.1OOD Perplexity
30
Apr 1, 2026
18.53ID PPL
30
Apr 1, 2026
67.2MRR
16
Feb 26, 2026
7.64Perplexity
12
Feb 26, 2026
0.615MRR
10
Feb 26, 2026
66.4Token Accuracy
9
Feb 26, 2026
29.17Tail Accuracy
5
Jul 2, 2026
28.78BERT-Small Next Token Accuracy (eps=inf)
5
Feb 26, 2026
25.75Accuracy (ϵ=∞)
5
Feb 26, 2026
18.8Perplexity
5
Feb 26, 2026
18.4PPL
5
Feb 26, 2026
640Bits per Token (BPT)
4
May 28, 2026
0.362Beta Score
4
May 11, 2026
32.82Acc (BERT-Small, Epsilon=Inf)
4
Feb 26, 2026
4.28BPD
4
Feb 26, 2026
1.62Bits Per Dimension
4
Feb 26, 2026
7.61BPD
4
Feb 26, 2026
99.8Accuracy
3
Mar 12, 2026
100Accuracy
3
Mar 12, 2026