Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LLM Judging Agreement research benchmarks · SOTA2 Research

LLM Judging Agreement

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Reasoning Agreement Benchmark 500-sample human-annotated

0.91Cohen's Kappa

15

Jun 12, 2026

Reasoning Agreement Benchmark 2,500 samples

100Parsing Success Rate

15

Jun 12, 2026

Popular datasets

Reasoning Agreement Benchmark

Follow for updates

Join SOTA2 Contact