Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Preference Optimization research benchmarks · SOTA2 Research

Preference Optimization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Helpful Assistant

53Helpfulness Score

30

Jun 8, 2026

Roleplay 1500 users

90.9Winrate

10

Apr 20, 2026

Alpaca-GPT4 Style

85.3Win Rate

5

Mar 4, 2026

Alpaca-GPT4 (Expertise)

76.97Win Rate

5

Mar 4, 2026

Synthetic Color

85.66Win Rate

5

Mar 4, 2026

HelpSteer2 (test)

0.8Avg Pref Score vs QWEN2.5-0.5B

5

Feb 26, 2026

Popular datasets

Alpaca Synthetic HelpSteer Helpful Assistant Roleplay

Follow for updates

Join SOTA2 Contact