Prompt Injection Defense on PI (CSQA) random topology
50ASR @1No Defense
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| No DefenseBackbone=Qwen3-235B-A22B2026.01 | 50 | 70.7 | 79.3 | 51.7 | 28.3 | 16.7 | |
| AgentXposed-KickBackbone=Qwen3-235B-A22B2026.01 | 47.7 | 70.7 | 78 | 55 | 25 | 16.7 | |
| AgentXposed-GuideBackbone=Qwen3-235B-A22B2026.01 | 47.3 | 70.7 | 77 | 58.3 | 26.7 | 18.3 | |
| InspectorBackbone=Qwen3-235B-A22B2026.01 | 46.5 | 65.3 | 76.3 | 51.7 | 35 | 21.7 | |
| AgentSafeBackbone=Qwen3-235B-A22B2026.01 | 44.6 | 65.4 | 75.8 | 55 | 35 | 21.7 | |
| AgentXposed-GuideBackbone=GPT-4o-mini2026.01 | 43.7 | 51 | 55.3 | 56.7 | 50 | 46.7 | |
| AgentSafeBackbone=GPT-4o-mini2026.01 | 37.5 | 48.9 | 55.6 | 63.3 | 48.3 | 40 | |
| AgentXposed-KickBackbone=GPT-4o-mini2026.01 | 37 | 45.3 | 49 | 61.7 | 53.3 | 51.7 | |
| No DefenseBackbone=GPT-4o-mini2026.01 | 36 | 50.2 | 59.3 | 65.3 | 50.3 | 41.7 | |
| G-safeguardBackbone=GPT-4o-mini2026.01 | 31.7 | 30.7 | 31.7 | 66.7 | 70 | 68.3 | |
| InspectorBackbone=GPT-4o-mini2026.01 | 27.2 | 27.1 | 26.9 | 69.2 | 73.1 | 73.1 | |
| ChallengerBackbone=GPT-4o-mini2026.01 | 25.3 | 41 | 45.9 | 63.3 | 55 | 51.7 | |
| INFA-GUARDBackbone=GPT-4o-mini2026.01 | 24.3 | 23.3 | 23.3 | 75 | 76.7 | 76.7 | |
| ChallengerBackbone=Qwen3-235B-A22B2026.01 | 21.1 | 56.3 | 72.8 | 58.3 | 28.3 | 18.3 | |
| G-safeguardBackbone=Qwen3-235B-A22B2026.01 | 21 | 24.3 | 26.3 | 83.3 | 76.7 | 78.3 | |
| INFA-GUARDBackbone=Qwen3-235B-A22B2026.01 | 12.3 | 12.7 | 13.4 | 90 | 86.7 | 86.7 |