User Simulation
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
55Accuracy (%)
19
Apr 20, 2026
34.8Accuracy
19
Apr 20, 2026
87.4Conv Score
16
Jun 15, 2026
93Primary Metric Score
15
Jun 15, 2026
38.12F1 Score
13
Apr 14, 2026
29.74F1 Score
13
Apr 14, 2026
31.45F1 Score
13
Apr 14, 2026
95Robotics Score
11
Feb 26, 2026
95.21Role Score
11
Feb 26, 2026
8.62Turn Count
8
May 13, 2026
0.713Realism Score (LLM-judge)
6
May 21, 2026
25.4Avg. Words per Turn
5
May 13, 2026
12.1Average Words per Turn
5
May 13, 2026
40.58News Score
3
Mar 5, 2026