Phishing Response Generation on GuardPhish Email
99Response RateVicuna 13B
Evaluation results
| Method | Links | |
|---|---|---|
| Vicuna 13BParameters=13B2026.04 | 99 | |
| Phi-3 14BParameters=14B2026.04 | 98.5 | |
| Mistral Small 24BParameters=24B2026.04 | 86 | |
| Qwen 2.5 7BParameters=7B2026.04 | 79.5 | |
| OLMo 2 7BParameters=7B2026.04 | 62 | |
| DeepSeek-R1 8BParameters=8B2026.04 | 60 | |
| Gemma 2 27BParameters=27B2026.04 | 48 | |
| LLaMA 3.1 8BParameters=8B2026.04 | 4 |