Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Preference Modeling research benchmarks · SOTA2 Research

Preference Modeling

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

61.4Accuracy

30

May 27, 2026

87.6Accuracy

20

Mar 11, 2026

Instruction Following

65.2Accuracy

20

Mar 11, 2026

Helpfulness & Harmlessness

72.2Accuracy

20

Mar 11, 2026

68.42Factuality

10

May 19, 2026

73.2Win Rate

9

Feb 26, 2026

PPT (Distribution) + TS

1.09NLL

8

Jun 11, 2026

PPT (Distribution) + TS

1.08NLL

8

Jun 11, 2026

HelpSteer2 held-out (test)

68.4Preference Accuracy

7

Mar 4, 2026

MultiPref held-out (test)

66.4Preference Accuracy

6

Mar 4, 2026

GAIP 1.0 (test)

0.319NDCG@5

4

Feb 26, 2026

Popular datasets

RewardBench HH-RLHF Arena-Hard Instruction Following BT

Follow for updates

Join SOTA2 Contact