Behavioral Stylometry on Lichess 10k-40k+ (all)
98.2AccuracyBehavioral Stylometry Transformer
Evaluation Results
| Method | Links | |
|---|---|---|
| Behavioral Stylometry TransformerEvaluation Pool=all, E=0, C=2844, Move index (k)=02022.08 | 98.2 | |
| Behavioral Stylometry TransformerEvaluation Pool=seen, E=0, C=2844, Move index (k)=02022.08 | 98.2 | |
| Behavioral Stylometry TransformerEvaluation Pool=unseen, E=0, C=2844, Move index (k)=02022.08 | 97.9 | |
| BaselineEvaluation Pool=all, E=0, C=2844, Move index (k)=02022.08 | 93 | |
| BaselineEvaluation Pool=seen, E=0, C=2844, Move index (k)=02022.08 | 93 | |
| BaselineEvaluation Pool=unseen, E=0, C=2844, Move index (k)=02022.08 | 92.9 | |
| High-Ranked ModelNumber of moves (|E|)=15, Candidate pool size (|C|)=2844, Reference pool size=28442022.08 | 85.4 | |
| 400 ModelEvaluation Pool=seen, E=0, C=2844, Move index (k)=02022.08 | 81.5 | |
| 400 ModelEvaluation Pool=all, E=0, C=2844, Move index (k)=02022.08 | 81 | |
| 400 ModelEvaluation Pool=unseen, E=0, C=2844, Move index (k)=02022.08 | 79.1 | |
| High-Ranked ModelNumber of moves (|E|)=15, Candidate pool size (|C|)=4911, Reference pool size=49112022.08 | 59.5 | |
| Universal ModelNumber of moves (|E|)=15, Candidate pool size (|C|)=2844, Reference pool size=28442022.08 | 51.5 | |
| High ModelEvaluation Pool=seen, E=0, C=2844, Move index (k)=02022.08 | 46.4 | |
| High ModelEvaluation Pool=all, E=0, C=2844, Move index (k)=02022.08 | 45.5 | |
| High ModelEvaluation Pool=unseen, E=0, C=2844, Move index (k)=02022.08 | 41.9 | |
| Universal ModelNumber of moves (|E|)=15, Candidate pool size (|C|)=4911, Reference pool size=49112022.08 | 32.5 | |
| Behavioral Stylometry TransformerNumber of moves (|E|)=15, Candidate pool size (|C|)=2844, Reference pool size=28442022.08 | 26.8 | |
| 400-Game ModelNumber of moves (|E|)=15, Candidate pool size (|C|)=2844, Reference pool size=28442022.08 | 20.2 | |
| Behavioral Stylometry TransformerNumber of moves (|E|)=15, Candidate pool size (|C|)=4911, Reference pool size=49112022.08 | 15.8 | |
| 400-Game ModelNumber of moves (|E|)=15, Candidate pool size (|C|)=4911, Reference pool size=49112022.08 | 13.6 |