LMSYS
Benchmarks
TaskDatasetSOTA resultTrendResults
LMSYS harmful queries
1Attack Success Rate
20
LMSYS In-Dist.
51.8GPT-4o Score
17
LMSYS (test)
60.98LLM-Judge
17
LMSYS
68.33MAE
16
LMSYS (test)
0.11Average Latency (s)
12
LMSys
47.3Match Rate
4
LMSYS trace
246GPUs Used
2