Safety Evaluation on XSTest (Safe Compl., Unsafe Ref.)
98.1Safe ComplianceSFT-Combined
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SFT-CombinedBase Model=Qwen3-4B-Instruct-25072026.04 | 98.1 | 44.8 | |
| SafeRLHFBase Model=Qwen3-4B-Instruct-25072026.04 | 98 | 47.9 | |
| Lag-DPOBase Model=Qwen3-4B-Instruct-25072026.04 | 98 | 64.3 | |
| Multi-Neg DPOBase Model=Qwen3-4B-Instruct-25072026.04 | 97.1 | 36 | |
| SFT-AnchorBase Model=Qwen3-4B-Instruct-25072026.04 | 97 | 33 | |
| MODPOBase Model=Qwen3-4B-Instruct-25072026.04 | 95.8 | 59.5 | |
| PCGrad-DPOBase Model=Qwen3-4B-Instruct-25072026.04 | 95.2 | 37 | |
| VanillaBase Model=Qwen3-4B-Instruct-25072026.04 | 95 | 38 | |
| SACPOBase Model=Qwen3-4B-Instruct-25072026.04 | 95 | 62 |