Indirect Prompt Injection Red-teaming on OwnCloud
0ASR (Confidentiality)Claude 3.5 Sonnet
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Claude 3.5 SonnetAgent Category=Adapted LLM-based Agents2025.05 | 0 | 48.67 | 35 | 43.33 | 58 | 65 | |
| Claude 3.7 SonnetAgent Category=Adapted LLM-based Agents2025.05 | 0 | 46 | 38.33 | 50 | 51.33 | 65 | |
| GPT-4oAgent Category=Adapted LLM-based Agents2025.05 | 0 | 90.67 | 43.33 | 73.33 | 94 | 80 | |
| Claude 3.5 Sonnet | CUAAgent Category=Specialized Computer-Use Agents2025.05 | 0 | 50.67 | 13.33 | 52.54 | 68 | 68.33 | |
| Claude 3.7 Sonnet | CUAAgent Category=Specialized Computer-Use Agents2025.05 | 0 | 60 | 35 | 50 | 64 | 71.67 | |
| Operator (w/o checks)Agent Category=Specialized Computer-Use Agents2025.05 | 0 | 54 | 37.29 | 49.15 | 58.67 | 74.58 | |
| OperatorAgent Category=Specialized Computer-Use Agents2025.05 | 0 | 16 | 11.86 | 20.34 | 18.67 | 22.03 |