Relevance Judgment Agreement
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
0.418Cohen's Kappa
9
Feb 26, 2026
0.43Cohen's Kappa
9
Feb 26, 2026
0.492Cohen's Kappa
9
Feb 26, 2026
0.455Cohen's Kappa
9
Feb 26, 2026
0.499Cohen's Kappa
9
Feb 26, 2026
0.418Cohen's Kappa
7
Feb 26, 2026
0.425Cohen's Kappa
7
Feb 26, 2026
0.492Cohen's Kappa
7
Feb 26, 2026
0.45Cohen's Kappa
7
Feb 26, 2026
0.499Cohen's Kappa
7
Feb 26, 2026