Question Answering on Dolly Closed QA
100ASRNo Defense
Evaluation results
| Method | Links | ||
|---|---|---|---|
| No DefenseAttack=Strategy2026.04 | 100 | 39 | |
| PromptArmorAttack=Strategy2026.04 | 100 | 41 | |
| PromptGuardAttack=Strategy2026.04 | 100 | — | |
| DataFilterAttack=Strategy2026.04 | 98 | 43 | |
| No DefenseAttack=Combined2026.04 | 95 | 69 | |
| PISanitizerAttack=Strategy2026.04 | 93 | 48 | |
| No DefenseAttack=Direct2026.04 | 92 | 69 | |
| DataSentinelAttack=Strategy2026.04 | 84 | — | |
| PIGuardAttack=Strategy2026.04 | 84 | — | |
| DataFilterAttack=Direct2026.04 | 80 | 73 | |
| PromptArmorAttack=Direct2026.04 | 78 | 78 | |
| PromptArmorAttack=Combined2026.04 | 60 | 80 | |
| DataSentinelAttack=Direct2026.04 | 53 | — | |
| DataFilterAttack=Combined2026.04 | 34 | 77 | |
| SecAlign++Attack=Strategy2026.04 | 30 | 88 | |
| PIGuardAttack=Direct2026.04 | 27 | — | |
| PromptGuardAttack=Direct2026.04 | 26 | — | |
| DataSentinelAttack=Combined2026.04 | 18 | — | |
| PISanitizerAttack=Direct2026.04 | 15 | 94 | |
| PISanitizerAttack=Combined2026.04 | 7 | 94 | |
| SecAlign++Attack=Combined2026.04 | 6 | 79 | |
| No DefenseAttack=No Attack2026.04 | 3 | 99 | |
| PISanitizerAttack=No Attack2026.04 | 3 | 99 | |
| SecAlign++Attack=Direct2026.04 | 3 | 77 | |
| DataFilterAttack=No Attack2026.04 | 3 | 98 | |
| PromptArmorAttack=No Attack2026.04 | 3 | 99 | |
| DataSentinelAttack=No Attack2026.04 | 3 | 98 | |
| PIGuardAttack=No Attack2026.04 | 3 | 98 | |
| PromptGuardAttack=No Attack2026.04 | 2 | 91 | |
| SecAlign++Attack=No Attack2026.04 | 1 | 76 | |
| Attn.TrackerAttack=Strategy2026.04 | 1 | — | |
| PIGuardAttack=Combined2026.04 | 1 | — | |
| PromptGuardAttack=Combined2026.04 | 0 | — | |
| Attn.TrackerAttack=No Attack2026.04 | 0 | 38 | |
| Attn.TrackerAttack=Combined2026.04 | 0 | — | |
| Attn.TrackerAttack=Direct2026.04 | 0 | — |