Safety Evaluation on Aggregate JBB, SR, WJ
13.9Reasoning AverageIPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IPOBackbone=Qwen3-8B2025.09 | 13.9 | 8.4 | |
| IPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 15.3 | 6.9 | |
| IPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 18.4 | 7.1 | |
| GRPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 18.5 | 17.8 | |
| STARBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 22.6 | 12.5 | |
| GRPOBackbone=Qwen3-8B2025.09 | 23.3 | 18.7 | |
| GRPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 24.7 | 20 | |
| STARBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 26.5 | 16.5 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 28.1 | 19.2 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 30.9 | 18.8 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 34.2 | 2.7 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 36.4 | 1.7 | |
| BaseBackbone=Qwen3-8B2025.09 | 51.3 | 34.1 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 59.4 | 39.9 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 60.7 | 42.2 | |
| BaseBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 71.5 | 56.1 | |
| BaseBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 72.9 | 60.9 |