LLM Personalization on BeaverTails (test)
72.1Personalization Win RatePTDPO
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PTDPOPersona Source=Pretr, Baseline Method=DPO2025.01 | 72.1 | 18.2 | 9.6 | 36.7 | 24.4 | 38.9 | 36.8 | |
| PTFSPersona Source=Pgold, Baseline Method=FS2025.01 | 68.7 | 14.5 | 16.9 | 62.9 | 15.9 | 21.3 | 55 | |
| PTDPOPersona Source=Pgold, Baseline Method=DPO2025.01 | 66.3 | 21.4 | 12.2 | 40.9 | 28.5 | 30.7 | 41.6 | |
| PTFSPersona Source=Pretr, Baseline Method=FS2025.01 | 62.5 | 17.2 | 20.2 | 60.7 | 14.2 | 25.1 | 46.3 | |
| PTSFTPersona Source=Pgold, Baseline Method=SFT2025.01 | 46.7 | 32 | 21.2 | 38.2 | 29.6 | 32.2 | 23 | |
| PTSFTPersona Source=Pretr, Baseline Method=SFT2025.01 | 44.6 | 31.7 | 23.7 | 33.5 | 28.6 | 37.8 | 12.3 |