ResearchBenchmarksPreference Alignment on IMDBFollow42.7Human Win RateCOALA11.18819.36927.5535.731May 22, 2026Evaluation ResultsMethodMethodLinksHuman Win RateCOALA2026.0542.7COALA2026.0542.7DPO2026.0524.8DPO2026.0524.8ORPO2026.0520.1ORPO2026.0520.1SFT2026.0512.4SFT2026.0512.4