Agent Security on ASB (Agent Security Benchmark)
90No Attack UAAttriGuard
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AttriGuardModel=Qwen3-32B2026.03 | 90 | 65.25 | 58.75 | 68.25 | 46.75 | 72.75 | 47 | 73.75 | 54 | 70 | 51.63 | |
| Qwen3-32BAttack=No Defense2026.03 | 80 | 31.25 | 91.25 | 50.25 | 71 | 57.25 | 86.75 | 62.5 | 95.5 | 50.31 | 86.13 | |
| Llama3.3-70BAttack=No Defense2026.03 | 80 | 89.5 | 39.5 | 87.25 | 43.25 | 89.5 | 47.5 | 90 | 45.5 | 89.06 | 43.94 | |
| AttriGuardModel=Llama3.3-70B2026.03 | 80 | 87.75 | 37 | 89 | 38 | 87.75 | 39.75 | 86.75 | 38 | 87.81 | 38.19 | |
| AttriGuardModel=GPT-4.1-mini2026.03 | 75.5 | 52.5 | 45 | 55.25 | 37.25 | 61.25 | 41 | 55.5 | 38.5 | 56.13 | 40.44 | |
| GPT-4.1-miniAttack=No Defense2026.03 | 74.5 | 38.25 | 83.75 | 36.5 | 79.5 | 53.25 | 94.25 | 49.25 | 94.25 | 44.31 | 87.94 | |
| AttriGuardModel=Gemini-2.5 Flash2026.03 | 51.25 | 36.5 | 14.75 | 47 | 17.25 | 38.25 | 17.5 | 35.25 | 18.5 | 39.25 | 17 | |
| Gemini-2.5 FlashAttack=No Defense2026.03 | 50 | 19 | 50.75 | 45.25 | 32.75 | 9.5 | 61.75 | 7.75 | 63 | 20.38 | 52.06 |