Prompt Exfiltration on Trae coding agent prompts
92.1Similarity ScoreToolLeak
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ToolLeak2025.09 | 92.1 | 46.6 | |
| Ignore2025.09 | 61.9 | 94.5 | |
| Naive2025.09 | 61.8 | 94.2 | |
| Ignore-Completion2025.09 | 59.6 | 96 | |
| Ignore-Completion-Remember2025.09 | 58.5 | 95.8 | |
| Completion2025.09 | 57.7 | 96.1 | |
| Remember-the-Start2025.09 | 56.1 | 93.5 | |
| Ignore-Remember2025.09 | 55.7 | 94.3 | |
| Completion-Remember2025.09 | 53.8 | 96.1 | |
| PLeak2025.09 | 23.6 | 95.2 |