Phishing Response Generation on GuardPhish SMS
98Response RateVicuna 13B
Evaluation results
| Method | Links | |
|---|---|---|
| Vicuna 13BParameters=13B2026.04 | 98 | |
| Phi-3 14BParameters=14B2026.04 | 84 | |
| Qwen 2.5 7BParameters=7B2026.04 | 63.5 | |
| OLMo 2 7BParameters=7B2026.04 | 49.5 | |
| Gemma 2 27BParameters=27B2026.04 | 49 | |
| DeepSeek-R1 8BParameters=8B2026.04 | 48.5 | |
| Mistral Small 24BParameters=24B2026.04 | 44.5 | |
| LLaMA 3.1 8BParameters=8B2026.04 | 33.5 |