Skill Invocation Safety Auditing on SIA-Bench Locked in-distribution (test)
20.4HR-AUPRCFusion
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Fusion2026.04 | 20.4 | 11.8 | 20 | 0.098 | 27.7 | 32.1 | |
| Contextual2026.04 | 19.5 | 10.5 | 17.8 | 0.112 | 21.6 | 28.8 | |
| Text-Only2026.04 | 18.9 | 6.6 | 11.1 | 0.073 | 21.7 | 28.8 | |
| Static Prior2026.04 | 18.8 | 12.2 | 20.6 | 0.031 | 14.9 | 29.1 | |
| Denylist2026.04 | 18.8 | 12.2 | 20.6 | 0.031 | 14.9 | 29.1 | |
| No Audit2026.04 | 16.9 | 10 | 16.9 | 0 | 32.1 | 32.1 | |
| Agent-Audit2026.04 | 16.9 | 9 | 15.2 | 0.015 | 31.8 | 31.9 |