Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LMArena dataset and benchmarks · SOTA2 Research

Research Datasets

LMArena

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

LMArena-based simulation

-2.5Top-8 Ranked Candidates

9

Held-out Elo Estimation

LMArena (held-out models)

0.6Beta Coefficient

8

Judge Agreement and Model Ranking

LMArena 140K

0.213Kappa (κ)

7

User Preference

LMArena

50Win Rate vs. Generative UI

4

Expert Preference Pairwise

LMArena Expert Med

0.476Kendall's tau_b

3

General Preference Pairwise

LMArena Med

0.594Kendall's Tau_b

3

Popular tasks

General Preference Pairwise Expert Preference Pairwise User Preference LLM Ranking Held-out Elo Estimation

Follow for updates

Join SOTA2 Contact