Label Classification on Custom Malware Dataset (test)
77F1 ScoreClaude-4.5 Sonnet
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude-4.5 SonnetProtocol=Off-the-shelf, Sample size=400, Prompting=task-specific2026.06 | 77 | 77 | |
| Llama-4 Maverick-17BProtocol=Off-the-shelf, Sample size=400, Prompting=task-specific2026.06 | 69 | 69 | |
| Nemotron 3-Super 120BProtocol=Off-the-shelf, Sample size=400, Prompting=task-specific2026.06 | 63 | 63 | |
| Llama-3.1-8BProtocol=PEFT, Sample size=entire test set, Fine-tuned parameters=115M2026.06 | 37 | 37 |