Alignment on HH IDN 40%
68Win RateUDPO
Evaluation Results
| Method | Links | |
|---|---|---|
| UDPOBase Model=Qwen-3-1.7B2026.07 | 68 | |
| α-UDPOBase Model=Qwen-3-1.7B2026.07 | 67.6 | |
| rDPOBase Model=Qwen-3-1.7B2026.07 | 63.7 | |
| DPOBase Model=Qwen-3-1.7B2026.07 | 56.4 | |
| α-URMBase Model=Qwen-3-1.7B2026.07 | 55.2 | |
| URMBase Model=Qwen-3-1.7B2026.07 | 54.6 | |
| rRMBase Model=Qwen-3-1.7B2026.07 | 48.2 | |
| RMBase Model=Qwen-3-1.7B2026.07 | 46 |