Prompt Injection Detection on WAInjectBench 1.0 (test)
80TPR (EIA)GPT-4o-prompt
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4o-promptDetection Type=Image-based, Time (s)=14.502026.04 | 80 | — | 0 | 84 | 92 | 4 | 0 | 89 | 93 | 0 | 55 | 71 | |
| SnapGuardDetection Type=Image-based, Time (s)=1.81, Mem (MB)=0.002026.04 | 80 | — | 53 | 70 | 71 | 75 | 13 | 82 | 81 | 9 | 66 | 75 | |
| PromptGuardDetection Type=Text-based (OCR), Time (s)=0.01, Mem (MB)=1157.202026.04 | 55 | — | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 7 | 13 | |
| Embedding-IDetection Type=Image-based, Time (s)=0.04, Mem (MB)=591.002026.04 | 44 | — | 71 | 47 | 44 | 36 | 28 | 48 | 37 | 25 | 44 | 52 | |
| PromptArmorDetection Type=Text-based (OCR), Time (s)=1.312026.04 | 39 | — | 0 | 0 | 38 | 0 | 0 | 76 | 78 | 0 | 29 | 45 | |
| LLaVA-1.5-7B-FTDetection Type=Image-based, Time (s)=0.18, Mem (MB)=13594.002026.04 | 14 | — | 3 | 21 | 4 | 22 | 2 | 20 | 21 | 4 | 13 | 23 | |
| JailGuardDetection Type=Image-based, Time (s)=6.12, Mem (MB)=13840.002026.04 | 5 | — | 2 | 5 | 0 | 45 | 4 | 2 | 2 | 28 | 8 | 12 | |
| KADDetection Type=Text-based (OCR), Time (s)=0.48, Mem (MB)=16062.802026.04 | 2 | — | 1 | 8 | 2 | 0 | 6 | 0 | 0 | 2 | 2 | 5 | |
| DataSentinelDetection Type=Text-based (OCR), Time (s)=0.66, Mem (MB)=7387.602026.04 | 2 | — | 0 | 8 | 2 | 0 | 7 | 0 | 0 | 1 | 2 | 5 | |
| LLaVA-1.5-7BDetection Type=Image-based, Time (s)=0.19, Mem (MB)=13875.002026.04 | 0 | — | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Embedding-TDetection Type=Text-based (OCR), Time (s)=0.00, Mem (MB)=236.302026.04 | 0 | — | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |