Indirect Prompt Injection Red-teaming on RTC-BENCH Aggregated (OwnCloud, Reddit, RocketChat)
66.19ASR (Avg)GPT-4o
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4oAgent Category=Adapted LLM-based Agents2025.05 | 66.19 | 92.45 | |
| Claude 3.7 Sonnet | CUAAgent Category=Specialized Computer-Use Agents2025.05 | 42.93 | 64.39 | |
| Claude 3.5 SonnetAgent Category=Adapted LLM-based Agents2025.05 | 41.37 | 64.27 | |
| Claude 3.7 SonnetAgent Category=Adapted LLM-based Agents2025.05 | 39.33 | 58.99 | |
| Claude 3.5 Sonnet | CUAAgent Category=Specialized Computer-Use Agents2025.05 | 31.21 | 74.43 | |
| Operator (w/o checks)Agent Category=Specialized Computer-Use Agents2025.05 | 30.89 | 47.84 | |
| OperatorAgent Category=Specialized Computer-Use Agents2025.05 | 7.57 | 14.06 |