System Prompt Exfiltration on WindSurf Agent Environment
100Pseudo-RecallToolLeak
Evaluation results
| Method | Links | |
|---|---|---|
| ToolLeakBackend LLM=sonnet-42025.09 | 100 | |
| ToolLeakBackend LLM=sonnet-4.52025.09 | 100 | |
| ToolLeakBackend LLM=SWE-1.52025.09 | 91 | |
| ToolLeakBackend LLM=gemini-2.5-pro2025.09 | 72 | |
| IgnoreBackend LLM=gemini-2.5-pro2025.09 | 63 | |
| NaiveBackend LLM=SWE-1.52025.09 | 42 | |
| Remember-the-StartBackend LLM=SWE-1.52025.09 | 42 | |
| Ignore-RememberBackend LLM=SWE-1.52025.09 | 42 | |
| Completion-RememberBackend LLM=SWE-1.52025.09 | 42 | |
| Ignore-Completion-RememberBackend LLM=SWE-1.52025.09 | 42 |