Direct Preference Optimization on Skywork AlpacaEval 2.0
20.56LCWRDifficulty-Based Preference Data Selection
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Difficulty-Based Preference Data SelectionSelection Method=Ours2025.08 | 20.56 | 19.38 | |
| RandomSelection Method=Random2025.08 | 19.6 | 18.57 | |
| ZIP†Selection Method=ZIP2025.08 | 18.74 | 18.96 | |
| Full SetSelection Method=Full Set2025.08 | 18.13 | 17.54 | |
| DiverseEvol†Selection Method=DiverseEvol2025.08 | 17.75 | 18.33 | |
| SDPOSelection Method=SDPO2025.08 | 17.46 | 18.56 | |
| Tulu3-SFTSelection Method=SFT Baseline2025.08 | 2.57 | 2.16 |