Prefill Attack Robustness on AdvBench 50 OOD harmful prompts-prefill pairs 2025
80PARACT
Evaluation results
| Method | Links | |
|---|---|---|
| ACTBackbone=Gemma-3-27B-it2026.06 | 80 | |
| Baseline (no defense)Backbone=Llama-3.1-8B-Instruct2026.06 | 52 | |
| ACTBackbone=Llama-3.1-8B-Instruct2026.06 | 50 | |
| AttCTBackbone=Llama-3.1-8B-Instruct2026.06 | 46 | |
| Baseline (no defense)Backbone=Gemma-3-27B-it2026.06 | 36 | |
| AttCTBackbone=Gemma-3-27B-it2026.06 | 36 | |
| BCTBackbone=Llama-3.1-8B-Instruct2026.06 | 0 | |
| MLPCT+BCTBackbone=Llama-3.1-8B-Instruct2026.06 | 0 | |
| BCTBackbone=Gemma-3-27B-it2026.06 | 0 | |
| MLPCT+BCTBackbone=Gemma-3-27B-it2026.06 | 0 |