Lichess
Benchmarks
TaskDatasetSOTA resultTrendResults
LICHESS
54.5Performance
40
Lichess sample April 2026 (month-wide slice)
0.174Brier Score
28
Lichess-16M
99.5Success Rate
20
Lichess 10k-40k+ (all)
98.2Accuracy
20
Lichess High-ranked subsets
0.651Accuracy
16
Lichess High-ranked ∪ 10K-40K+
80.6Accuracy
12
Lichess (Blitz)
2,940Elo Rating (vs. Bots)
9
Lichess 40k+ players
100Accuracy
8
Lichess 30k-40k+ players
100Accuracy
8
Lichess 20k-40k+ players
100Accuracy
8
Lichess 10k-40k+ (unseen)
0.86Accuracy
8
Lichess SPECIALIZATION
69.57Probe Accuracy
7
Lichess April 2026 (held-out slice)
0.184Brier Score
7
Lichess 10k+ games (all)
98.2P@1
6
Lichess 10k+ games (seen)
98.2P@1
6
Lichess 10k+ games (unseen)
97.9P@1
6
Lichess all policies (aggregate)
0.512P Score
4
Lichess pool
99.5Accuracy
4
Lichess High-ranked (unseen)
30.1Accuracy
4
Lichess High-ranked (seen)
26.5Accuracy
4
Lichess High-ranked high only C (unseen)
30.8Accuracy
4
Lichess High-ranked high only C (seen)
27.3Accuracy
4
Lichess High-ranked ∪ 10K-40K+ (seen)
59Accuracy
4
Lichess 40k+ (unseen)
90Accuracy
4
Lichess 40k+ (seen)
89.5Accuracy
4