Malicious Skill Detection on ClawHub
95Overall Detection RateSkillVetBench
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SkillVetBench2026.05 | 95 | 100 | 100 | 91 | 0 | 100 | 98 | 89 | 0 | 100 | 80 | 89 | 0 | 0 | 0 | |
| SkillSieve2026.05 | 84 | 80 | 80 | 80 | 20 | 75 | 100 | 86 | 25 | 75 | 100 | 86 | 25 | 1 | 5 | |
| SkillProbe2026.05 | 82 | 80 | 80 | 80 | 20 | 75 | 75 | 75 | 25 | 75 | 75 | 75 | 25 | 2 | 9 | |
| LLMshot_count=few-shot2026.05 | 80 | 80 | 80 | 80 | 20 | 75 | 75 | 75 | 25 | 75 | 75 | 75 | 25 | 2 | 9 | |
| LLMshot_count=0-shot2026.05 | 76 | 60 | 75 | 67 | 40 | 50 | 67 | 57 | 50 | 50 | 67 | 57 | 50 | 3 | 14 | |
| CodeBERT2026.05 | 68 | 40 | 100 | 57 | 60 | 50 | 100 | 67 | 50 | 50 | 100 | 67 | 50 | 0 | 0 | |
| ClawScan2026.05 | 56 | 20 | 100 | 33 | 80 | 25 | 100 | 40 | 75 | 50 | 100 | 67 | 50 | 1 | 5 | |
| ClawVet2026.05 | 53 | 20 | 100 | 33 | 80 | 25 | 100 | 40 | 75 | 25 | 100 | 40 | 75 | 1 | 5 | |
| VirusTotal2026.05 | 46 | 0 | — | — | 100 | 25 | 100 | 40 | 75 | 0 | — | — | 100 | 2 | 9 |