Preference Alignment on UltraFeedback (test) (Pairwise Win Rate excl. ties)
62.35Pairwise Win Rate (excl. ties)COALA
Evaluation Results
| Method | Links | |
|---|---|---|
| COALABackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 62.35 | |
| DPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 57.89 | |
| ORPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 35.29 | |
| SFTBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 25.56 | |
| SimPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 17.65 |