Multi-turn Safety Risk Assessment on Filesystem
96ASRw/o Defense
Evaluation results
| Method | Links | ||
|---|---|---|---|
| w/o DefenseModel=Claude-3.5-Sonnet2026.02 | 96 | 0 | |
| FirewallModel=Claude-3.5-Sonnet2026.02 | 92 | 4 | |
| w/o DefenseModel=Gemini-1.5-Flash2026.02 | 80 | 8 | |
| FirewallModel=Gemini-1.5-Flash2026.02 | 76 | 12 | |
| BaselineModel=Gemini-1.5-Flash2026.02 | 68 | 16 | |
| ToolShieldModel=Gemini-1.5-Flash2026.02 | 64 | 24 | |
| BaselineModel=Claude-3.5-Sonnet2026.02 | 52 | 40 | |
| ToolShieldModel=Claude-3.5-Sonnet2026.02 | 28 | 68 |