Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LMSYS dataset and benchmarks · SOTA2 Research

Research Datasets

LMSYS

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Robustness against harmful content generation

LMSYS harmful queries

1Attack Success Rate

20

Instruction Following Evaluation

LMSYS In-Dist.

51.8GPT-4o Score

17

Proactive next utterance prediction

LMSYS (test)

60.98LLM-Judge

17

Output Length Prediction

LMSYS

68.33MAE

16

LLM Request Scheduling

LMSYS (test)

0.11Average Latency (s)

12

KV cache reuse efficiency

LMSys

47.3Match Rate

4

LLM Serving Efficiency

LMSYS trace

246GPUs Used

2

Popular tasks

Instruction Following Evaluation Output Length Prediction Proactive next utterance prediction Robustness against harmful content generation LLM Serving Efficiency

Follow for updates

Join SOTA2 Contact