Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LLM-as-a-Judge Evaluation Consistency research benchmarks · SOTA2 Research

LLM-as-a-Judge Evaluation Consistency

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

83.25Kappa

36

Feb 26, 2026

71.88Kappa

6

Feb 26, 2026

PreferenceBench

79.73Kappa

4

Feb 26, 2026

Popular datasets

RewardBench MTBench PreferenceBench

Follow for updates

Join SOTA2 Contact