Phishing Attack Generation on GuardPhish SMS vector 1.0
98ASRVicuna 13B
Evaluation results
| Method | Links | |
|---|---|---|
| Vicuna 13BModel Family=Vicuna, Parameters=13B2026.04 | 98 | |
| Phi-3 14BModel Family=Phi-3, Parameters=14B2026.04 | 82 | |
| Qwen 2.5 7BModel Family=Qwen 2.5, Parameters=7B2026.04 | 61.5 | |
| OLMo 2 7BModel Family=OLMo 2, Parameters=7B2026.04 | 48.5 | |
| Gemma 2 27BModel Family=Gemma 2, Parameters=27B2026.04 | 48 | |
| Mistral Small 24BModel Family=Mistral, Parameters=24B2026.04 | 44.5 | |
| DeepSeek-R1 8BModel Family=DeepSeek-R1, Parameters=8B2026.04 | 37 | |
| LLaMA 3.1 8BModel Family=LLaMA 3.1, Parameters=8B2026.04 | 33.5 |