Agent Security on A3S-BENCH Advanced 1.0
19.68RTR@1Sonnet 4.5
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Sonnet 4.52026.05 | 19.68 | 13.77 | 8.42 | 4.35 | -0.21 | |
| GPT-5.22026.05 | 30.47 | 19.82 | 11.45 | 4.07 | -0.48 | |
| GLM-52026.05 | 35.94 | 22.87 | 11.71 | 4 | 0.19 | |
| Avg.2026.05 | 52.57 | 38.4 | 24.49 | 3.53 | -0.49 | |
| Kimi-K2.52026.05 | 55.08 | 36.24 | 20.51 | 3.55 | -0.62 | |
| Qwen3.5-397B2026.05 | 55.24 | 37.6 | 25.05 | 3.51 | -0.57 | |
| MiniMax-M2.52026.05 | 59.49 | 46.97 | 33.07 | 3.3 | -0.64 | |
| DeepSeek-V4-F2026.05 | 60.47 | 42.83 | 24.79 | 3.38 | -0.74 | |
| DeepSeek-V3.22026.05 | 64.32 | 47.52 | 30.72 | 3.23 | -0.55 | |
| Qwen3.5-122B2026.05 | 67.37 | 53.6 | 35.53 | 3.08 | -0.63 | |
| Qwen3.5-35B2026.05 | 77.69 | 62.81 | 43.68 | 2.81 | -0.66 |