Preference Alignment on HARMLESS
72.9GRA (%)CW-DPO
Evaluation results
| Method | Links | |
|---|---|---|
| CW-DPOWeak-to-Strong Model Pair=OPT-125M → OPT-1.3B2026.03 | 72.9 | |
| CW-DPOWeak-to-Strong Model Pair=Qwen2.5-0.5B → Qwen2.5-7B2026.03 | 72 | |
| Human (100%)Weak-to-Strong Model Pair=OPT-125M → OPT-1.3B2026.03 | 69.2 | |
| Human (100%)Weak-to-Strong Model Pair=Qwen2.5-0.5B → Qwen2.5-7B2026.03 | 65.7 |