Preference Alignment on HELPFUL
72.7GRA (%)CW-DPO
Evaluation results
| Method | Links | |
|---|---|---|
| CW-DPOWeak-to-Strong Model Pair=OPT-125M → OPT-1.3B2026.03 | 72.7 | |
| CW-DPOWeak-to-Strong Model Pair=Qwen2.5-0.5B → Qwen2.5-7B2026.03 | 70.8 | |
| Human (100%)Weak-to-Strong Model Pair=OPT-125M → OPT-1.3B2026.03 | 70.2 | |
| Human (100%)Weak-to-Strong Model Pair=Qwen2.5-0.5B → Qwen2.5-7B2026.03 | 58.5 |