Multi-task Adversarial Attack Evaluation on COCO, Flickr30k, TextVQA, VQAv2, POPE
79.8Average SRRPA-Attack
Evaluation results
| Method | Links | |
|---|---|---|
| PA-AttackModel=LLaVa1.5-13B, Perturbation (ε)=4/2552026.02 | 79.8 | |
| PA-AttackModel=LLaVa1.5-7B, Perturbation (ε)=4/2552026.02 | 79 | |
| PA-AttackModel=LLaVa1.5-13B, Perturbation (ε)=2/2552026.02 | 77.3 | |
| PA-AttackModel=LLaVa1.5-7B, Perturbation (ε)=2/2552026.02 | 77.1 | |
| VEAttackModel=LLaVa1.5-13B, Perturbation (ε)=4/2552026.02 | 72.4 | |
| VEAttackModel=LLaVa1.5-7B, Perturbation (ε)=4/2552026.02 | 71.2 | |
| VEAttackModel=LLaVa1.5-13B, Perturbation (ε)=2/2552026.02 | 67.1 | |
| PA-AttackModel=OF-9B, Perturbation (ε)=4/2552026.02 | 66.4 | |
| VEAttackModel=LLaVa1.5-7B, Perturbation (ε)=2/2552026.02 | 65.2 | |
| PA-AttackModel=OF-9B, Perturbation (ε)=2/2552026.02 | 63.4 | |
| VEAttackModel=OF-9B, Perturbation (ε)=4/2552026.02 | 61.5 | |
| AttackVLM-iiModel=OF-9B, Perturbation (ε)=4/2552026.02 | 59.8 | |
| VT-AttackModel=LLaVa1.5-7B, Perturbation (ε)=4/2552026.02 | 59.6 | |
| AttackVLM-iiModel=LLaVa1.5-13B, Perturbation (ε)=4/2552026.02 | 56.6 | |
| VT-AttackModel=LLaVa1.5-13B, Perturbation (ε)=4/2552026.02 | 54.9 | |
| AttackVLM-iiModel=LLaVa1.5-7B, Perturbation (ε)=4/2552026.02 | 54.5 | |
| VEAttackModel=OF-9B, Perturbation (ε)=2/2552026.02 | 52.3 | |
| MIX.AttackModel=OF-9B, Perturbation (ε)=4/2552026.02 | 49.2 | |
| AttackVLM-iiModel=OF-9B, Perturbation (ε)=2/2552026.02 | 46.1 | |
| AttackVLM-iiModel=LLaVa1.5-13B, Perturbation (ε)=2/2552026.02 | 45.3 | |
| AttackVLM-iiModel=LLaVa1.5-7B, Perturbation (ε)=2/2552026.02 | 43.3 | |
| MIX.AttackModel=LLaVa1.5-13B, Perturbation (ε)=4/2552026.02 | 39.9 | |
| MIX.AttackModel=LLaVa1.5-7B, Perturbation (ε)=4/2552026.02 | 38.9 | |
| VT-AttackModel=OF-9B, Perturbation (ε)=4/2552026.02 | 37.9 | |
| MIX.AttackModel=LLaVa1.5-13B, Perturbation (ε)=2/2552026.02 | 31.8 | |
| VT-AttackModel=LLaVa1.5-7B, Perturbation (ε)=2/2552026.02 | 31.6 | |
| MIX.AttackModel=OF-9B, Perturbation (ε)=2/2552026.02 | 31.6 | |
| MIX.AttackModel=LLaVa1.5-7B, Perturbation (ε)=2/2552026.02 | 31.2 | |
| VT-AttackModel=LLaVa1.5-13B, Perturbation (ε)=2/2552026.02 | 30.5 | |
| VT-AttackModel=OF-9B, Perturbation (ε)=2/2552026.02 | 25 | |
| CleanModel=LLaVa1.5-7B2026.02 | 0 | |
| CleanModel=OF-9B2026.02 | 0 | |
| CleanModel=LLaVa1.5-13B2026.02 | 0 |