Malware Family Classification on Custom Malware Dataset (test)
50Weighted AccuracyClaude-4.5 Sonnet
Evaluation results
| Method | Links | |
|---|---|---|
| Claude-4.5 SonnetProtocol=Off-the-shelf, Sample size=400, Prompting=task-specific2026.06 | 50 | |
| Nemotron 3-Super 120BProtocol=Off-the-shelf, Sample size=400, Prompting=task-specific2026.06 | 49 | |
| Llama-4 Maverick-17BProtocol=Off-the-shelf, Sample size=400, Prompting=task-specific2026.06 | 48 | |
| Llama-3.1-8BProtocol=PEFT, Sample size=entire test set, Fine-tuned parameters=115M2026.06 | 3 |