Preference Alignment on Skywork
80Win Rate (W)Greedy SFT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Greedy SFTBase Model=Llama 8B2025.09 | 80 | — | 13.25 | |
| Greedy DPOBase Model=Llama 8B2025.09 | 78 | — | 13.64 | |
| Bo2Base Model=Llama 8B2025.09 | 76 | — | 14.15 | |
| Bo2Base Model=Qwen 4B2025.09 | 76 | — | 9.35 | |
| Greedy SFTBase Model=Qwen 4B2025.09 | 75 | — | 9.34 | |
| Greedy SFTBase Model=Llama 3B2025.09 | 74 | — | 7.93 | |
| Bo2Base Model=Llama 3B2025.09 | 74 | — | 9.04 | |
| Greedy DPOBase Model=Qwen 4B2025.09 | 74 | — | 9.54 | |
| Bo2Base Model=Qwen 0.6B2025.09 | 73 | — | -5.18 | |
| Greedy SFTModel=Llama 3B, Training Protocol=full finetuning2025.09 | 72 | 7.93 | — | |
| Greedy DPOBase Model=Llama 3B2025.09 | 72 | — | 8.45 | |
| EFTBase Model=Llama 8B2025.09 | 72 | — | 15.57 | |
| EFTBase Model=Qwen 4B2025.09 | 71 | — | 10.35 | |
| EFTBase Model=Llama 3B2025.09 | 68 | — | 10.03 | |
| Greedy SFTBase Model=Qwen 0.6B2025.09 | 66 | — | -4.41 | |
| Greedy DPOBase Model=Qwen 0.6B2025.09 | 66 | — | -3.73 | |
| Bo2Model=Llama 3B, Training Protocol=full finetuning2025.09 | 63 | 11.71 | — | |
| Greedy DPOModel=Llama 3B, Training Protocol=full finetuning2025.09 | 61 | 11.5 | — | |
| Greedy SFTModel=Llama 1B, Training Protocol=full finetuning2025.09 | 60 | -0.95 | — | |
| EFTBase Model=Qwen 0.6B2025.09 | 58 | — | -1.88 | |
| Bo2Model=Llama 1B, Training Protocol=full finetuning2025.09 | 57 | 0.47 | — | |
| EFTModel=Llama 3B, Training Protocol=full finetuning2025.09 | 56 | 12.12 | — | |
| Greedy DPOModel=Llama 1B, Training Protocol=full finetuning2025.09 | 51 | 1.12 | — | |
| EFTModel=Llama 1B, Training Protocol=full finetuning2025.09 | 48 | 2 | — | |
| AADModel=Llama 1B, Training Protocol=full finetuning2025.09 | — | 1.55 | — | |
| AADModel=Llama 3B, Training Protocol=full finetuning2025.09 | — | 13.4 | — | |
| AADBase Model=Llama 3B2025.09 | — | — | 13.71 | |
| AADBase Model=Llama 8B2025.09 | — | — | 19.27 | |
| AADBase Model=Qwen 0.6B2025.09 | — | — | -0.01 | |
| AADBase Model=Qwen 4B2025.09 | — | — | 14.44 |