Role-playing evaluation
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
85.67LLM-as-a-Judge Score
44
Jun 15, 2026
8.85Memory Adherence (SI)
12
Mar 23, 2026
9.13MA-SI Score
12
Mar 23, 2026
4.35Average Performance (Auto)
8
May 29, 2026
1.59Human Mean Rank
5
Jun 15, 2026
0.21Overall MSE
5
Apr 16, 2026