Harmful Content Safety Evaluation on AdvBench
0.19Attack Success Rate (ASR)Star1
Evaluation Results
| Method | Links | |
|---|---|---|
| Star1Backbone Model=Qwen3-8B2026.06 | 0.19 | |
| SafePathBackbone Model=Qwen3-8B2026.06 | 0.38 | |
| ST-DBackbone Model=Qwen3-8B2026.06 | 0.38 | |
| ST-SBackbone Model=Qwen3-8B2026.06 | 0.58 | |
| ST-DBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 0.58 | |
| ST-SBackbone Model=Qwen3-32B2026.06 | 1.35 | |
| ST-SBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 1.35 | |
| ST-DBackbone Model=Qwen3-32B2026.06 | 1.73 | |
| BaseBackbone Model=Qwen3-8B2026.06 | 1.92 | |
| BaseBackbone Model=Qwen3-32B2026.06 | 3.85 | |
| ST-DBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 4.42 | |
| SafePathBackbone Model=Qwen3-32B2026.06 | 4.81 | |
| Star1Backbone Model=Qwen3-32B2026.06 | 6.73 | |
| ST-SBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 9.62 | |
| Star1Backbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 14.04 | |
| SafePathBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 14.62 | |
| Star1Backbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 18.65 | |
| SafePathBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 20.96 | |
| BaseBackbone Model=DeepSeek-R1-Distill-Llama-70B2026.06 | 26.15 | |
| BaseBackbone Model=DeepSeek-R1-Distill-Llama-8B2026.06 | 35.19 |