Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LLM-as-a-Judge Calibration research benchmarks · SOTA2 Research

LLM-as-a-Judge Calibration

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Arena100K (test)

Test oracle envelope

0.227Test Risk (MSE)

7

Jun 2, 2026

SummEval (test)

Test oracle envelope

0.043Test Risk (MSE)

7

Jun 2, 2026

Test oracle envelope

0.194Test Risk (MSE)

7

Jun 2, 2026

RewardBench (test)

Test oracle envelope

0.022Test Risk (MSE)

7

Jun 2, 2026

Popular datasets

RewardBench SummEval LLMBar Arena100K

Follow for updates

Join SOTA2 Contact