Jailbreak Safety Evaluation on Multi-Shot Jailbreak (MSJ)
0ASRST-S
Evaluation Results
| Method | Links | |
|---|---|---|
| ST-SBackbone Model=Qwen3-8B2026.06 | 0 | |
| ST-SBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 0 | |
| ST-DBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 0 | |
| ST-DBackbone Model=Qwen3-8B2026.06 | 2 | |
| ST-DBackbone Model=Qwen3-32B2026.06 | 2 | |
| ST-SBackbone Model=Qwen3-32B2026.06 | 4 | |
| BaseBackbone Model=Qwen3-8B2026.06 | 8 | |
| ST-DBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 8 | |
| Star1Backbone Model=Qwen3-8B2026.06 | 10 | |
| BaseBackbone Model=Qwen3-32B2026.06 | 10 | |
| SafePathBackbone Model=Qwen3-32B2026.06 | 10 | |
| Star1Backbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 10 | |
| SafePathBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 10 | |
| Star1Backbone Model=Qwen3-32B2026.06 | 12 | |
| ST-SBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 14 | |
| SafePathBackbone Model=Qwen3-8B2026.06 | 18 | |
| BaseBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 18 | |
| Star1Backbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 54 | |
| SafePathBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 58 | |
| BaseBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 68 |