Preference Prediction on UltraFeedback 500 held-out users (test)
70.53Test AccuracyRFM(32)
Evaluation Results
| Method | Links | |
|---|---|---|
| RFM(32)n_hat=102025.03 | 70.53 | |
| Linear baselinen_hat=102025.03 | 62.85 | |
| Baselinen_hat=102025.03 | 62.58 | |
| Non-linear phi (3 layers)n_hat=1002025.03 | 57.06 | |
| Non-linear phi (5 layers)n_hat=1002025.03 | 56.2 | |
| Non-linear phi (3 layers)n_hat=102025.03 | 55.43 | |
| Non-linear phi (5 layers)n_hat=102025.03 | 52.37 |