Preference Alignment on IMDb (test)
60.91Pairwise Win Rate (Excl. Ties)COALA
Evaluation results
| Method | Links | |
|---|---|---|
| COALABackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 60.91 | |
| DPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 60 | |
| ORPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 50.5 | |
| SFTBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 21.25 | |
| SimPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 0 |