Summarization on Reddit TL;DR (test)
75.61Preference vs SFT (%)Cal-DPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Cal-DPO2024.12 | 75.61 | 59.37 | 67.49 | — | |
| CPO2024.12 | 73.13 | 58.89 | 66.01 | — | |
| DPOP2024.12 | 72.95 | 58.82 | 65.89 | — | |
| IPO2024.12 | 72.17 | 56.51 | 64.34 | — | |
| DPO2024.12 | 71.22 | 57.58 | 64.4 | — | |
| DPO+NLL2024.12 | 69.37 | 55.26 | 62.31 | — | |
| SLiC2024.12 | 68.61 | 55.72 | 62.17 | — | |
| f-DPO2024.12 | 66.19 | 51.37 | 58.78 | — | |
| SCARComparison Baseline=RLHF, LLM Judge=gemini-2.5-pro2025.12 | — | — | — | 61.2 | |
| SCARComparison Baseline=ABC, LLM Judge=gemini-2.5-pro2025.12 | — | — | — | 60.3 |