HH
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HH Balance-8
4.317Conformity Score
17
HH (test)
90.8Win Rate (0% Flip)
14
HH (test)
3.876Reward
14
HH dataset
-0.96Reward
13
HH (Anthropic Helpful and Harmless)
82.5Win Rate (0% Flip)
10
HH Harmless
3.25Beaver-7B Cost Score
10
HH IDN 40%
68Win Rate
8
HH (IDN 20%)
78.2Win Rate
8
HH-Helpful
52Win Count
8
HH
25.18Avg NLL (Model)
6
HH dataset
59.1WCWR
5
HH (40% noise)
57Win Rate
3
HH 20% noise
58.7Win Rate
3
HH 0% noise
61.6Win Rate
3
HH dataset
59Win Rate
3
HH Helpful
55Preference (spec vs ctl)
1
HH helpful
149Win/Loss Count
1