Reddit Summary (Faithful vs Preference 1) on Reddit (test)
1.23HypervolumeRewards-in-Context
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Rewards-in-ContextBackbone=LLama-2 7B2025.02 | 1.23 | 2.03 | 82 | 6 | 39 | 0.08 | |
| Bone SoupBackbone=LLama-2 7B2025.02 | 1.12 | 1.89 | 100 | 11 | 29 | 0.03 | |
| MODBackbone=LLama-2 7B2025.02 | 0.62 | 1.17 | 100 | 11 | 18 | 0.02 | |
| Rewarded SoupsBackbone=LLama-2 7B2025.02 | 0.61 | 1.13 | 100 | 11 | 17 | 0.01 |