Prompt Injection Attack Defense on BIPIA
0ASRPrompt Guard
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Prompt Guard2026.04 | 0 | 0.33 | 9.22 | 1,077.71 | — | — | |
| SelfDefendMode=Direct2026.04 | 0 | 19.33 | 0.4 | 13,113.04 | — | — | |
| SelfGrader2026.04 | 0 | 5.33 | 0.3 | 328.91 | — | — | |
| SCOUTJudge=GPT-4o2026.05 | 0.026 | — | 0.309 | — | 97.1 | 96.8 | |
| Always-DLLMJudge=GPT-4o2026.05 | 0.044 | — | 1.654 | — | 89.4 | 83.2 | |
| SCOUTJudge=GPT-5.12026.05 | 0.058 | — | 0.433 | — | 96.1 | 98 | |
| Always-DLLMJudge=GPT-5.12026.05 | 0.236 | — | 1.586 | — | 87.3 | 98.2 | |
| GradientCuff2026.04 | 0.33 | 39.33 | 10.49 | 827.33 | — | — | |
| SelfDefendMode=Intent2026.04 | 0.33 | 67.66 | 1.26 | 13,116.22 | — | — | |
| WildGuardMode=Pre2026.04 | 0.66 | 81.66 | 1.58 | 27,861.87 | — | — | |
| WildGuardMode=Post2026.04 | 0.66 | 89 | 1.49 | 27,882.3 | — | — | |
| GuardReasonerMode=Pre2026.04 | 1 | 89.33 | 8.58 | 15,414.55 | — | — | |
| GuardReasonerMode=Post2026.04 | 1 | 97.66 | 8.22 | 15,414.6 | — | — | |
| LLama-3-8B-InstructDefense=No Defense2026.04 | 1.33 | — | — | — | — | — | |
| Perplexity Filter2026.04 | 1.33 | 100 | 0.09 | 13,112.46 | — | — | |
| Llama GuardMode=Pre2026.04 | 1.33 | 100 | 0.22 | 13,571.94 | — | — | |
| Llama GuardMode=Post2026.04 | 1.33 | 100 | 0.22 | 13,598.72 | — | — |