Malicious PTM Detection on Malicious PTM Detection Dataset Benign Malicious 2025
2,025Benign CountFickling
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FicklingAnalysis Type=Static2026.04 | 2,025 | 25 | 1,000 | 1,000 | 2,025 | 0 | 2,025 | 0 | 50 | 100 | 66.67 | |
| Llama-3.1Analysis Type=Dynamic2026.04 | 1,337 | 22 | 993 | 995 | 2,010 | 688 | 1,337 | 15 | 60.05 | 99.26 | 74.83 | |
| GPT-5.2Analysis Type=+ LLM2026.04 | 12 | 20 | 988 | 796 | 1,804 | 2,013 | 12 | 221 | 99.33 | 89.09 | 93.93 | |
| DynaHug (default)Analysis Type=Dynamic2026.04 | 1 | 25 | 1,000 | 986 | 2,011 | 2,024 | 1 | 14 | 99.95 | 99.31 | 99.63 | |
| PickleScanAnalysis Type=Static2026.04 | 0 | 23 | 1,000 | 44 | 1,067 | 2,025 | 0 | 958 | 100 | 52.69 | 69.02 | |
| ModelScanAnalysis Type=Static2026.04 | 0 | 23 | 1,000 | 44 | 1,067 | 2,025 | 0 | 958 | 100 | 52.69 | 69.02 | |
| ModelTracerAnalysis Type=Dynamic2026.04 | 0 | 25 | 828 | 907 | 1,760 | 2,025 | 0 | 265 | 100 | 86.91 | 92.99 |