Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Pairwise Preference Evaluation research benchmarks · SOTA2 Research

Pairwise Preference Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

61Context 1 Preference Score

21

May 12, 2026

40-triplet (val)

91HFS

15

Jun 25, 2026

Conversational Evaluation Suite AI companionship and Role-play (test)

95.5Win Rate

13

Feb 26, 2026

60.6Pairwise Win Rate

4

Feb 26, 2026

52.9Pairwise Win Rate

3

Feb 26, 2026

Popular datasets

GovReport Conversational Evaluation Suite RAR COMMON2SENSE 40-triplet

Follow for updates

Join SOTA2 Contact