Harmful Refusal on AdvBench
99.4Refusal Rate (String Match)LlamaGuard prompt-filter
Evaluation Results
| Method | Links | |
|---|---|---|
| LlamaGuard prompt-filterDraft Model=Llama-3.1-8B2026.06 | 99.4 | |
| LlamaGuard response-filterDraft Model=Llama-3.1-8B2026.06 | 99.4 | |
| Hard prefixDraft Model=Llama-3.1-8B, K (Beam Count)=12026.06 | 97.7 | |
| ALIGNBEAMDraft Model=Llama-3.1-8B, K (Beam Count)=32026.06 | 94.4 | |
| Base draftDraft Model=Llama-3.1-8B2026.06 | 17.5 | |
| Safety promptDraft Model=Llama-3.1-8B2026.06 | 15.6 |