Safety Evaluation on DrAttack
95.49Safety ScoreREFLECTOR (+GDPO)
Evaluation results
| Method | Links | |
|---|---|---|
| REFLECTOR (+GDPO)Backbone=Llama-3.1-8B-Instruct2026.05 | 95.49 | |
| REFLECTOR (+GDPO)Backbone=Qwen-2.5-7B-Instruct2026.05 | 92.5 | |
| REFLECTOR (+SFT)Backbone=Llama-3.1-8B-Instruct2026.05 | 89.88 | |
| REFLECTOR (SFT)Backbone=Qwen-2.5-7B-Instruct2026.05 | 85.17 | |
| STAIRBackbone=Qwen-2.5-7B-Instruct2026.05 | 73.07 | |
| STAIRBackbone=Llama-3.1-8B-Instruct2026.05 | 70.31 | |
| Shallow-AlignBackbone=Qwen-2.5-7B-Instruct2026.05 | 67.8 | |
| Shallow-AlignBackbone=Llama-3.1-8B-Instruct2026.05 | 65.4 | |
| Self-CritiqueBackbone=Qwen-2.5-7B-Instruct2026.05 | 40.38 | |
| DPOBackbone=Qwen-2.5-7B-Instruct2026.05 | 35.58 | |
| Self-CritiqueBackbone=Llama-3.1-8B-Instruct2026.05 | 34 | |
| DPOBackbone=Llama-3.1-8B-Instruct2026.05 | 32 | |
| SFTBackbone=Qwen-2.5-7B-Instruct2026.05 | 30.76 | |
| SFTBackbone=Llama-3.1-8B-Instruct2026.05 | 30.5 | |
| OriginalBackbone=Llama-3.1-8B-Instruct2026.05 | 29.8 | |
| OriginalBackbone=Qwen-2.5-7B-Instruct2026.05 | 28.84 |