Suffix Jailbreak Attack on HarmBench
6Inference TimeBEAST
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BEASTInference Framework=sglang, Target Model=llama32026.03 | 6 | 14.96 | |
| BEASTInference Framework=sglang, Target Model=Qwen2.52026.03 | 6 | 14.23 | |
| BEASTInference Framework=sglang, Target Model=mistral2026.03 | 7 | 13.5 | |
| BEASTInference Framework=sglang, Target Model=vicuna2026.03 | 8 | 13.42 | |
| BEASTInference Framework=sglang, Target Model=llama22026.03 | 9 | 12.87 | |
| BEASTInference Framework=vLLM, Target Model=Qwen2.52026.03 | 15 | 13.52 | |
| BEASTInference Framework=vLLM, Target Model=vicuna2026.03 | 16 | 12.55 | |
| BEASTInference Framework=vLLM, Target Model=llama22026.03 | 16 | 12.57 | |
| BEASTInference Framework=vLLM, Target Model=mistral2026.03 | 16 | 12.73 | |
| BEASTInference Framework=vLLM, Target Model=llama32026.03 | 17 | 14.96 |