Instruction Following on AlpacaEval UltraFeedback 2 (test)
53.37LC Win RateOTPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OTPOBackbone=Llama-3-8b-Instruct2025.05 | 53.37 | 47.58 | 1,791 | |
| SamPOBackbone=Llama-3-8b-Instruct2025.05 | 52.17 | 46.31 | 1,806 | |
| LDDPOBackbone=Llama-3-8b-Instruct2025.05 | 52.1 | 51.72 | 2,036 | |
| DPOBackbone=Llama-3-8b-Instruct2025.05 | 48.14 | 51.52 | 2,168 | |
| SimPOBackbone=Llama-3-8b-Instruct2025.05 | 47.56 | 40.72 | 1,756 | |
| OTPOBackbone=Llama-3.2-3b-Instruct2025.05 | 26.97 | 28.61 | 2,075 | |
| LDDPOBackbone=Llama-3.2-3b-Instruct2025.05 | 26.56 | 25.79 | 1,909 | |
| DPOBackbone=Llama-3.2-3b-Instruct2025.05 | 26.02 | 27.96 | 2,094 | |
| SamPOBackbone=Llama-3.2-3b-Instruct2025.05 | 24.08 | 26.49 | 2,084 | |
| InitialBackbone=Llama-3-8b-Instruct2025.05 | 22.92 | 22.57 | 1,899 | |
| SimPOBackbone=Llama-3.2-3b-Instruct2025.05 | 22.58 | 22.34 | 1,944 | |
| InitialBackbone=Llama-3.2-3b-Instruct2025.05 | 17.97 | 19.34 | 2,041 |