Attack Success Rate Evaluation on 40 diverse smartphone tasks Generate subcategory
75Target ASRHG-IDA*
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HG-IDA*Target Model=GPT-4o2025.10 | 75 | 50 | |
| HG-IDA*Target Model=Gemini-2.0-pro2025.10 | 75 | 75 | |
| HG-IDA*Target Model=Deepseek-VL22025.10 | 75 | 25 | |
| DATarget Model=Gemini-2.0-pro2025.10 | 50 | 0 | |
| PrefixTarget Model=Gemini-2.0-pro2025.10 | 25 | 0 | |
| GCGTarget Model=Gemini-2.0-pro2025.10 | 25 | 25 | |
| GCGTarget Model=Deepseek-VL22025.10 | 25 | 25 | |
| DATarget Model=LLaVA-OneVision2025.10 | 25 | 25 | |
| GCGTarget Model=LLaVA-OneVision2025.10 | 25 | 25 | |
| HG-IDA*Target Model=LLaVA-OneVision2025.10 | 25 | 25 | |
| DATarget Model=GPT-4o2025.10 | 0 | 0 | |
| PrefixTarget Model=GPT-4o2025.10 | 0 | 0 | |
| GCGTarget Model=GPT-4o2025.10 | 0 | 0 | |
| DATarget Model=Deepseek-VL22025.10 | 0 | 0 | |
| PrefixTarget Model=Deepseek-VL22025.10 | 0 | 0 | |
| PrefixTarget Model=LLaVA-OneVision2025.10 | 0 | 0 |