Secret Leakage Detection on 2,000-task multi-agent benchmark all evaluated defenses
0Task Leak RatePRISM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| PRISMOperation Mode=generation-time, Signals=temporal generation signals2026.05 | 0 | 0 | 71.2 | 83.2 | 100 | 0 | |
| Span TaggerOperation Mode=post-hoc filtering, Supervision=supervised2026.05 | 15 | 0.15 | 56.2 | 71.9 | 100 | 0 | |
| GBT ClassifierOperation Mode=post-hoc filtering, Supervision=supervised2026.05 | 19.2 | 2.49 | 52 | 68.4 | 100 | 0 | |
| detect-secretsOperation Mode=post-hoc filtering2026.05 | 43.3 | 0.45 | 27.9 | 43.6 | 100 | 0 | |
| PromptInstructionDefenseOperation Mode=post-hoc filtering2026.05 | 49.3 | 7.58 | 28 | 43.7 | 100 | 0 | |
| BasicGuardrailOperation Mode=post-hoc filtering2026.05 | 63.1 | 3.36 | 8.1 | 14.9 | 100 | 0 | |
| LLM JudgeOperation Mode=post-hoc filtering2026.05 | 63.1 | 3.36 | 8.1 | 14.9 | 100 | 0 | |
| TruffleHogOperation Mode=post-hoc filtering2026.05 | 64.2 | 5.97 | 7 | 13 | 100 | 0 | |
| PresidioOperation Mode=post-hoc filtering2026.05 | 65.8 | 3.01 | 5.4 | 10.2 | 100 | 0 | |
| NoFilterDescription=Undefended baseline2026.05 | 71.2 | 11.52 | — | — | — | — |