Safety Evaluation on StrongReject (SR)
16.7Reasoning Harmful RatioIPO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| IPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 16.7 | 10.9 | |
| GRPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 19 | 19.7 | |
| IPOBackbone=Qwen3-8B2025.09 | 19.3 | 13.7 | |
| IPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 20.7 | 8.4 | |
| STARBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 21.9 | 14.6 | |
| GRPOBackbone=Qwen3-8B2025.09 | 23.2 | 22.6 | |
| STARBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 24.9 | 17.8 | |
| GRPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 25.1 | 21.9 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 31.8 | 24.4 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 34.3 | 23.3 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 34.7 | 6.1 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 36.5 | 2.1 | |
| BaseBackbone=Qwen3-8B2025.09 | 49.6 | 33.8 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 55.3 | 38.7 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 57.6 | 42 | |
| BaseBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 63.2 | 49.3 | |
| BaseBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 63.9 | 51.9 |