Attack Success Rate Evaluation on 40 diverse smartphone tasks Execute
100TASRHG-IDA*
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HG-IDA*Target Model=Gemini-2.0-pro2025.10 | 100 | 100 | |
| HG-IDA*Target Model=Deepseek-VL22025.10 | 80 | 20 | |
| HG-IDA*Target Model=GPT-4o2025.10 | 60 | 60 | |
| PrefixTarget Model=Gemini-2.0-pro2025.10 | 60 | 40 | |
| DATarget Model=Gemini-2.0-pro2025.10 | 40 | 20 | |
| GCGTarget Model=Gemini-2.0-pro2025.10 | 40 | 40 | |
| GCGTarget Model=LLaVA-OneVision2025.10 | 40 | 40 | |
| HG-IDA*Target Model=LLaVA-OneVision2025.10 | 40 | 40 | |
| DATarget Model=LLaVA-OneVision2025.10 | 20 | 20 | |
| DATarget Model=GPT-4o2025.10 | 0 | 0 | |
| PrefixTarget Model=GPT-4o2025.10 | 0 | 0 | |
| GCGTarget Model=GPT-4o2025.10 | 0 | 0 | |
| DATarget Model=Deepseek-VL22025.10 | 0 | 0 | |
| PrefixTarget Model=Deepseek-VL22025.10 | 0 | 0 | |
| GCGTarget Model=Deepseek-VL22025.10 | 0 | 0 | |
| PrefixTarget Model=LLaVA-OneVision2025.10 | 0 | 0 |