Harmfulness Evaluation on PAIR
1.08Harmfulness ScoreSAFEPATH-FT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SAFEPATH-FTModel=R1-Llama-8B2025.08 | 1.08 | — | |
| RealSafe-R1Model=R1-Qwen-7B2025.08 | 1.24 | — | |
| ReasoningGuardModel=R1-Llama-8B2025.08 | 1.3 | — | |
| ReasoningGuardModel=R1-Qwen-7B2025.08 | 1.32 | — | |
| SAFEPATH-FTModel=R1-Qwen-7B2025.08 | 1.46 | — | |
| RealSafe-R1Model=R1-Llama-8B2025.08 | 1.46 | — | |
| SafeKeyModel=R1-Qwen-7B2025.08 | 1.52 | — | |
| ThinkingIModel=R1-Qwen-7B2025.08 | 1.66 | — | |
| ThinkingIModel=R1-Llama-8B2025.08 | 1.76 | — | |
| SafeKeyModel=R1-Llama-8B2025.08 | 1.86 | — | |
| SAFEPATH-ZSModel=R1-Llama-8B2025.08 | 2.26 | — | |
| SAFEPATH-ZSModel=R1-Qwen-7B2025.08 | 2.32 | — | |
| Self-ReminderModel=R1-Qwen-7B2025.08 | 2.46 | — | |
| Self-ReminderModel=R1-Llama-8B2025.08 | 3.2 | — | |
| ParaphraseModel=R1-Qwen-7B2025.08 | 3.26 | — | |
| SmoothLLMModel=R1-Llama-8B2025.08 | 3.48 | — | |
| SafeDecodingModel=R1-Qwen-7B2025.08 | 3.52 | — | |
| ParaphraseModel=R1-Llama-8B2025.08 | 3.58 | — | |
| No DefenseModel=R1-Qwen-7B2025.08 | 3.68 | — | |
| No DefenseModel=R1-Llama-8B2025.08 | 3.72 | — | |
| SmoothLLMModel=R1-Qwen-7B2025.08 | 3.8 | — | |
| SafeDecodingModel=R1-Llama-8B2025.08 | 3.82 | — | |
| DPOBackbone=Llama-3.1-8B-Instruct2026.05 | — | 85.65 | |
| DPOBackbone=Qwen-2.5-7B-Instruct2026.05 | — | 53.65 | |
| OriginalBackbone=Llama-3.1-8B-Instruct2026.05 | — | 83.4 | |
| OriginalBackbone=Qwen-2.5-7B-Instruct2026.05 | — | 43.5 | |
| REFLECTOR (+GDPO)Backbone=Llama-3.1-8B-Instruct2026.05 | — | 96.04 | |
| REFLECTOR (+GDPO)Backbone=Qwen-2.5-7B-Instruct2026.05 | — | 95.19 | |
| REFLECTOR (+SFT)Backbone=Llama-3.1-8B-Instruct2026.05 | — | 90.21 | |
| REFLECTOR (SFT)Backbone=Qwen-2.5-7B-Instruct2026.05 | — | 89.35 | |
| Self-CritiqueBackbone=Llama-3.1-8B-Instruct2026.05 | — | 81.19 | |
| Self-CritiqueBackbone=Qwen-2.5-7B-Instruct2026.05 | — | 41.81 | |
| SFTBackbone=Llama-3.1-8B-Instruct2026.05 | — | 80.92 | |
| SFTBackbone=Qwen-2.5-7B-Instruct2026.05 | — | 42.57 | |
| Shallow-AlignBackbone=Llama-3.1-8B-Instruct2026.05 | — | 86.1 | |
| Shallow-AlignBackbone=Qwen-2.5-7B-Instruct2026.05 | — | 84.2 | |
| STAIRBackbone=Llama-3.1-8B-Instruct2026.05 | — | 89.24 | |
| STAIRBackbone=Qwen-2.5-7B-Instruct2026.05 | — | 88.46 |