Prompt Injection Attack on PaperGuard
80Attack Success Rate (ASR)Claude-sonnet-4.5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude-sonnet-4.5Multimodality=true2026.06 | 80 | 14.14 | 1.13 | -2.62 | |
| Mistral-Small-3.1-24B-InstructMultimodality=true2026.06 | 76 | 9.95 | 0 | -3.26 | |
| Gemma-3-27b-itMultimodality=true2026.06 | 74 | 7.93 | 0.27 | -1.88 | |
| Qwen2.5-VL-32B-InstructMultimodality=true2026.06 | 73 | 7.11 | 0 | -2.43 | |
| GPT-4oMultimodality=true2026.06 | 72 | 6.65 | 0.13 | -1.37 | |
| GPT-4.1Multimodality=false2026.06 | 68 | 9.4 | 0.43 | -2.27 | |
| Qwen-3-8BMultimodality=false2026.06 | 64 | 4.16 | 0.3 | -1.39 | |
| DeepSeek-R1-Distill-Llama-8BMultimodality=false2026.06 | 46 | 5.05 | 0.46 | 0.11 |