Malicious Skill Detection on MaliciousAgentSkillsBench (404 malicious, 502 benign)
100RecallBIV
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BIVModel=Claude Sonnet 4.52026.05 | 100 | 99 | 99 | |
| BIVModel=Claude Sonnet 4.52026.05 | 98 | 92 | 95 | |
| LLM-only2026.05 | 93 | 99 | 96 | |
| LLM-only2026.05 | 89 | 97 | 93 | |
| BIVModel=Claude Sonnet 4.52026.05 | 86 | 57 | 69 | |
| LLM-only2026.05 | 64 | 74 | 68 | |
| Rule-based2026.05 | 45 | 88 | 60 | |
| Rule-based2026.05 | 39 | 20 | 26 | |
| Rule-based2026.05 | 35 | 62 | 44 |