Agent Security Evaluation on Agent Security Bench (ASB) (DPI CA & CI Avg)
92.42ASRReAct
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ReActBackbone=Gemini-2.5-Pro, Agent Category=Proprietary Agents2026.06 | 92.42 | 6.01 | 6.26 | |
| ReActBackbone=Qwen3-32B, Agent Category=Open-Source Agents2026.06 | 86.96 | 0 | 7.35 | |
| ReActAgent Backbone=Average over four backbones (Qwen3-32B, Kimi-2.5, Gemini-2.5-Pro, GPT-5.1)2026.06 | 79.94 | 15.38 | 6.98 | |
| ReActBackbone=GPT-5.1, Agent Category=Proprietary Agents2026.06 | 71.86 | 36.3 | 4.51 | |
| ReActBackbone=Kimi-2.5, Agent Category=Open-Source Agents2026.06 | 68.53 | 19.19 | 9.8 | |
| TRIAD + Tri-GuardBackbone=GPT-5.1, Agent Category=Proprietary Agents2026.06 | 17.4 | 72.38 | 7.5 | |
| TRIAD + TS-GuardBackbone=Kimi-2.5, Agent Category=Open-Source Agents2026.06 | 13.26 | 15.51 | 60.15 | |
| TRIAD + Tri-GuardAgent Backbone=Average over four backbones (Qwen3-32B, Kimi-2.5, Gemini-2.5-Pro, GPT-5.1)2026.06 | 13.04 | 64.52 | 24.73 | |
| TRIAD + TS-GuardBackbone=Gemini-2.5-Pro, Agent Category=Proprietary Agents2026.06 | 12.67 | 4.07 | 84.24 | |
| TRIAD + Tri-GuardBackbone=Kimi-2.5, Agent Category=Open-Source Agents2026.06 | 12.01 | 51.1 | 18.26 | |
| TRIAD + Tri-GuardBackbone=Qwen3-32B, Agent Category=Open-Source Agents2026.06 | 11.57 | 60.83 | 32.94 | |
| TRIAD + Tri-GuardBackbone=Gemini-2.5-Pro, Agent Category=Proprietary Agents2026.06 | 11.18 | 73.75 | 40.2 | |
| ToolSafeBackbone=Qwen3-32B, Agent Category=Open-Source Agents2026.06 | 10.25 | 1.54 | 44.98 | |
| TRIAD + TS-GuardBackbone=Qwen3-32B, Agent Category=Open-Source Agents2026.06 | 9.75 | 1.33 | 88.8 | |
| TRIAD + TS-GuardBackbone=GPT-5.1, Agent Category=Proprietary Agents2026.06 | 8.41 | 8.19 | 43.31 | |
| TRIAD + Qwen3.5-9BAgent Backbone=Average over four backbones (Qwen3-32B, Kimi-2.5, Gemini-2.5-Pro, GPT-5.1)2026.06 | 5.56 | 26.3 | 60.66 | |
| ToolSafeBackbone=Gemini-2.5-Pro, Agent Category=Proprietary Agents2026.06 | 4.53 | 7.33 | 74.19 | |
| ToolSafeBackbone=Kimi-2.5, Agent Category=Open-Source Agents2026.06 | 2.99 | 4.24 | 57.21 |