Preference Alignment on HelpSteer (test)
61.25Pairwise Win Rate (excl. ties)COALA
Evaluation Results
| Method | Links | |
|---|---|---|
| COALABackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 61.25 | |
| DPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 60.16 | |
| ORPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 58.82 | |
| SFTBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 56.25 | |
| SimPOBackbone=Llama-3.2-3B, Evaluation Protocol=ArenaHard Custom Pairwise WR ex Ties2026.05 | 0 |