Safety Refusal Evaluation on Alpaca & StrongReject benign & harmful
1Refusal Rate (Benign)SafeChain
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SafeChainBackbone=DS-R1_114B2026.03 | 1 | 47.1 | 63.4 | |
| SafeChainBackbone=Skywork_7B2026.03 | 1.4 | 48.7 | 64.5 | |
| Base ModelBackbone=DS-R1_7B2026.03 | 4 | 34 | 48.4 | |
| Base ModelBackbone=DS-R1_8B2026.03 | 4.4 | 47.1 | 61.1 | |
| PreSafeBackbone=DS-R1_8B2026.03 | 7 | 92.9 | 91 | |
| SafeChainBackbone=DS-R1_8B2026.03 | 7.8 | 38.8 | 51.3 | |
| Base ModelBackbone=DS-R1_114B2026.03 | 7.8 | 49.4 | 61 | |
| SafeChainBackbone=Qwen3_4B2026.03 | 8.6 | 51.6 | 62.4 | |
| PreSafeBackbone=DS-R1_114B2026.03 | 8.8 | 95.2 | 91 | |
| Base ModelBackbone=Skywork_7B2026.03 | 9 | 33 | 44.8 | |
| SafeChainBackbone=DS-R1_7B2026.03 | 9.6 | 45.2 | 56.3 | |
| PreSafeBackbone=Qwen3_4B2026.03 | 10.4 | 97.1 | 90.9 | |
| PreSafeBackbone=Qwen3_8B2026.03 | 10.8 | 95.5 | 89.8 | |
| SafeChainBackbone=Qwen3_8B2026.03 | 11 | 40.7 | 51.4 | |
| PreSafeBackbone=DS-R1_7B2026.03 | 11.4 | 94.6 | 88.9 | |
| Base ModelBackbone=Qwen3_8B2026.03 | 11.8 | 73.6 | 76.5 | |
| PreSafeBackbone=Skywork_7B2026.03 | 13.8 | 93 | 86.5 | |
| Base ModelBackbone=Qwen3_4B2026.03 | 16.8 | 74 | 73.7 | |
| R2DBackbone=DS-R1_114B2026.03 | 37.2 | 94.2 | 74.3 | |
| R2DBackbone=Skywork_7B2026.03 | 37.6 | 84 | 68.8 | |
| R2DBackbone=DS-R1_7B2026.03 | 38.2 | 83.7 | 68.4 | |
| R2DBackbone=DS-R1_8B2026.03 | 44.8 | 91.9 | 69.8 | |
| R2DBackbone=Qwen3_4B2026.03 | 50 | 90.6 | 67 | |
| R2DBackbone=Qwen3_8B2026.03 | 71.8 | 98.5 | 62.9 |