Phishing Detection on HTML-based PI (test)
0.3ASRInjectDefuser
Evaluation Results
| Method | Links | |
|---|---|---|
| InjectDefuserBackbone=GPT-5, Model Scale=Highest performance, Weight Visibility=closed-weight2026.02 | 0.3 | |
| AdvancedBackbone=GPT-5, Model Scale=Highest performance, Weight Visibility=closed-weight2026.02 | 10.1 | |
| InjectDefuserBackbone=Grok 4 Fast, Model Scale=Medium-scale, Weight Visibility=closed-weight, Reasoning Capability=Non-Reasoning2026.02 | 26.1 | |
| InjectDefuserBackbone=Gemma 3 27B, Model Scale=Lightweight, Weight Visibility=open-weight2026.02 | 36.7 | |
| StandardBackbone=GPT-5, Model Scale=Highest performance, Weight Visibility=closed-weight2026.02 | 39.9 | |
| AdvancedBackbone=Gemma 3 27B, Model Scale=Lightweight, Weight Visibility=open-weight2026.02 | 55.4 | |
| InjectDefuserBackbone=Llama 4 Maverick, Model Scale=Medium-scale, Weight Visibility=open-weight2026.02 | 61.7 | |
| StandardBackbone=Gemma 3 27B, Model Scale=Lightweight, Weight Visibility=open-weight2026.02 | 64.7 | |
| StandardBackbone=Grok 4 Fast, Model Scale=Medium-scale, Weight Visibility=closed-weight, Reasoning Capability=Non-Reasoning2026.02 | 65.1 | |
| AdvancedBackbone=Llama 4 Maverick, Model Scale=Medium-scale, Weight Visibility=open-weight2026.02 | 75.6 | |
| AdvancedBackbone=Grok 4 Fast, Model Scale=Medium-scale, Weight Visibility=closed-weight, Reasoning Capability=Non-Reasoning2026.02 | 76.2 | |
| StandardBackbone=Llama 4 Maverick, Model Scale=Medium-scale, Weight Visibility=open-weight2026.02 | 84.7 |