Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Preference Evaluation research benchmarks – Page 2 · SOTA2 Research

Preference Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Ultra-Real benchmark

πbias (rubric-based preference attack)

43.1Win Rate

2

Feb 26, 2026

LLM-as-a-Judge comparison set

33.7TCRM Better Rate

1

Apr 28, 2026

Page 2 of 2

Popular datasets

NISQA URGENT Ultra-Real Anthropic-SafeRLHF AlpacaEval

Follow for updates

Join SOTA2 Contact