Pairwise Human Preference Prediction on Stanford Human Preferences (SHP) (held-out)
75Accuracy (r/askhr)Supervised Model (RM)
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Supervised Model (RM)Model Architecture=SteamSHP-flan-t5-xl2026.03 | 75 | 65 | 72 | 74 | 68 | 80 | 72 | |
| Local Acceptance DensityBase Model=Pythia-2.8B, Density Context=Local2026.03 | 71 | 60 | 57 | 72 | 61 | 64 | 65 | |
| Global Acceptance DensityBase Model=Pythia-2.8B, Density Context=Global2026.03 | 68 | 53 | 51 | 60 | 57 | 59 | 49 | |
| kNNBase Model=Pythia-2.8B2026.03 | 55 | 49 | 50 | 58 | 49 | 50 | 52 | |
| RandomBase Model=Pythia-2.8B2026.03 | 50 | 50 | 50 | 50 | 50 | 50 | 50 |