Phishing Attack Generation on GuardPhish Email vector 1.0
97.5ASRVicuna 13B
Evaluation results
| Method | Links | |
|---|---|---|
| Vicuna 13BModel Family=Vicuna, Parameters=13B2026.04 | 97.5 | |
| Phi-3 14BModel Family=Phi-3, Parameters=14B2026.04 | 89 | |
| Mistral Small 24BModel Family=Mistral, Parameters=24B2026.04 | 85.5 | |
| Qwen 2.5 7BModel Family=Qwen 2.5, Parameters=7B2026.04 | 79.5 | |
| OLMo 2 7BModel Family=OLMo 2, Parameters=7B2026.04 | 59.5 | |
| Gemma 2 27BModel Family=Gemma 2, Parameters=27B2026.04 | 45.5 | |
| DeepSeek-R1 8BModel Family=DeepSeek-R1, Parameters=8B2026.04 | 26.5 | |
| LLaMA 3.1 8BModel Family=LLaMA 3.1, Parameters=8B2026.04 | 4 |