Jailbreak Safety Evaluation on StrongREJECT (test)
100Overall ScoreSTAIR-DPO
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| STAIR-DPOBase Model=Llama3.1-8B-Instruct, Evaluator=LlamaGuard, Prefilling=No2025.09 | 100 | 68.37 | 94.25 | 98.72 | 90.34 | |
| BaseBase Model=Llama3.1-8B-Instruct, Evaluator=LlamaGuard, Prefilling=No2025.09 | 99.68 | 35.14 | 64.86 | 52.4 | 63.02 | |
| WJ-SFTBase Model=Llama3.1-8B-Instruct, Evaluator=LlamaGuard, Prefilling=No2025.09 | 99.36 | 44.73 | 76.04 | 98.4 | 79.63 | |
| ReSA-SFTBase Model=Llama3.1-8B-Instruct, Evaluator=LlamaGuard, Prefilling=No2025.09 | 99.36 | 89.78 | 96.81 | 99.36 | 96.33 | |
| ReSA-SFTBase Model=Llama3.1-8B-Instruct, Evaluator=LlamaGuard, Prefilling=Yes2025.09 | 98.72 | 78.27 | 95.85 | 97.76 | 92.65 |