Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Reward Modeling research benchmarks – Page 7 · SOTA2 Research

Reward Modeling

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

PRISM Full (test)

61.11Chile Score

7

Jun 18, 2026

DeepSeek-V4-Flash

61.35Communication Score

7

Jun 8, 2026

Tutoring Dialogue Human Preference (test)

90Accuracy (%)

7

May 29, 2026

95.7Correlation

7

May 1, 2026

PAM∃LA held-out users (test)

0.451User SROCC

7

Apr 10, 2026

61.8Accuracy

7

Apr 2, 2026

61.6Accuracy

7

Apr 2, 2026

62.1Accuracy

7

Apr 2, 2026

TL;DR Overall n=150

62.9Accuracy

7

Apr 2, 2026

TL;DR Unseen (n=150)

62.4Accuracy

7

Apr 2, 2026

TL;DR n=150 Seen

63.3Accuracy

7

Apr 2, 2026

TL;DR n=100 Unseen

61.5Accuracy

7

Apr 2, 2026

PersonalLLM Near Uniform (α=0.1) Overall

96.6Accuracy

7

Apr 2, 2026

PersonalLLM Near Uniform (α=0.1) Unseen

96.4Accuracy

7

Apr 2, 2026

PersonalLLM Near Uniform (α=0.1) Seen

96.8Accuracy

7

Apr 2, 2026

PersonalLLM Moderately Diverse (α=0.01) Overall

95.1Accuracy

7

Apr 2, 2026

PersonalLLM Moderately Diverse (α=0.01) Unseen

94.7Accuracy

7

Apr 2, 2026

PersonalLLM Moderately Diverse (α=0.01) Seen

95.5Accuracy

7

Apr 2, 2026

PersonalLLM Very Diverse (α=0.001) Overall

95.3Accuracy

7

Apr 2, 2026

PersonalLLM Very Diverse (α=0.001) Unseen

95.1Accuracy

7

Apr 2, 2026

PersonalLLM Very Diverse (α=0.001) Seen

95.6Accuracy

7

Apr 2, 2026

OSWorld-Verified (Class-Imbalanced, Human Evaluation) 1.0 (test)

88.5Precision

7

Feb 26, 2026

OSWorld Verified Class-Imbalanced Test Scripts 1.0 (test)

61.9Precision

7

Feb 26, 2026

OSWorld Verified Class-Balanced Human Evaluation 1.0 (test)

94Precision

7

Feb 26, 2026

OSWorld Verified Class-Balanced Scripts 1.0 (test)

79.2Precision

7

Feb 26, 2026

Page 7 of 10

Popular datasets

RewardBench RM-Bench UltraFeedback PersonalLLM PPE

Follow for updates

Join SOTA2 Contact