Access Control Enforcement on 200 Adversarial Tool-Use Tasks 1.0 (test)
68.5UIRClaude Haiku 3.5
Evaluation results
| Method | Links | |
|---|---|---|
| Claude Haiku 3.5Access Control Condition=Unfiltered2026.05 | 68.5 | |
| Llama 3.1 8BAccess Control Condition=Unfiltered2026.05 | 66 | |
| Qwen 2.5 7BAccess Control Condition=Unfiltered2026.05 | 48.5 | |
| Qwen 2.5 7BAccess Control Condition=Prompted2026.05 | 37 | |
| Claude Haiku 3.5Access Control Condition=Prompted2026.05 | 11.5 | |
| Llama 3.1 8BAccess Control Condition=Prompted2026.05 | 4 | |
| Qwen 2.5 7BAccess Control Condition=Governed2026.05 | 0 | |
| Llama 3.1 8BAccess Control Condition=Governed2026.05 | 0 | |
| Claude Haiku 3.5Access Control Condition=Governed2026.05 | 0 |