Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Pairwise Evaluation research benchmarks · SOTA2 Research

Pairwise Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Human-crafted (existing) Rubrics

78.33Human Agreement

41

Jun 1, 2026

Fine-tuned Rubric Generator

72.4Human Agreement

37

Jun 1, 2026

Fine-tuned Rubric Generator

83.69Human Agreement Rate

9

Jun 1, 2026

pairwise evaluator

95.2Test Accuracy

4

Apr 14, 2026

Popular datasets

AlpacaEval MT-Bench HH-RLHF BiGGen

Follow for updates

Join SOTA2 Contact