HH-RLHF
Benchmarks
TaskDatasetSOTA resultTrendResults
HH-RLHF
9.08HV Score
10
HH-RLHF (held-out)
1.59Peak Gold Reward
9
HH-RLHF
100FTS@1
9
HH-RLHF (test)
0.687Loss
8
HH-RLHF
4.674Useful Score
8
full-hh-rlhf (test)
79.3Win Rate (Beaver-7b-v3.0-reward)
8
HH-RLHF helpful (test)
77Helpfulness Fraction
7
HH-RLHF
94.5Harmlessness Rate
6
HH-RLHF held-out (test)
53.02Win Rate
6
HH-RLHF (test)
100FTV@k=1
6
HH-RLHF (test)
4.596Likert Score Ranking
6
HH-RLHF Helpful vs Harmless (test)
1.24Hypervolume
6
HH-RLHF
81.7Coverage
5
HH-RLHF 100K samples (test)
82.3Helpfulness Score
5
HH-RLHF
10.435Hyper-volume
5
HH-RLHF D3 (test)
32.77Harmlessness BLEU Score
5
HH-RLHF D2 (test)
20.13Harmlessness BLEU
5
HH-RLHF 0-shot (test)
62.68Harmlessness BLEU
5
HH-RLHF
5.84Helpfulness Score (HV)
4
HH-RLHF
1.98Helpfulness Value (HV)
4
HH-RLHF (test)
95.2Test Accuracy
4
HH-RLHF (test)
2.481Reward
4
HH-RLHF (test)
2.772Reward
4
HH-RLHF (test)
2.542Reward
4
HH-RLHF Helpful vs Humor (test)
1.24Hypervolume
4