Adversarial Attack on COCO (val)
79.6MPBS
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PBSFlip Budget=F10, Target Model=BLIP2-OPT-6.7B2025.12 | 79.6 | 18.5 | 24.75 | 23.55 | 25.2 | 90.15 | 8.75 | |
| PBSFlip Budget=F60, Target Model=BLIP2-OPT-6.7B2025.12 | 79.05 | 19.4 | 24.85 | 23.05 | 21.2 | 87.75 | 8.29 | |
| PBSFlip Budget=F20, Target Model=BLIP2-OPT-6.7B2025.12 | 78.4 | 19.8 | 26.1 | 23.7 | 19 | 90.15 | 8.74 | |
| PBSFlip Budget=F40, Target Model=BLIP2-OPT-6.7B2025.12 | 77.9 | 20.1 | 25.85 | 24.1 | 21 | 90.35 | 7.93 | |
| PBSFlip Budget=F100, Target Model=BLIP2-OPT-6.7B2025.12 | 77.9 | 20.75 | 26.6 | 24.9 | 21.6 | 89.8 | 9.24 | |
| PBSFlip Budget=F5, Target Model=BLIP2-OPT-6.7B2025.12 | 77.85 | 20.65 | 27 | 25.3 | 21 | 93.65 | 10.33 | |
| PBSFlip Budget=F80, Target Model=BLIP2-OPT-6.7B2025.12 | 77.75 | 20.65 | 26.2 | 23.85 | 24.8 | 90.15 | 8.37 | |
| PBSFlip Budget=F4, Target Model=BLIP2-OPT-6.7B2025.12 | 74.45 | 23.65 | 31.9 | 29.7 | 22.4 | 94.05 | 13.13 | |
| PBSFlip Budget=F3, Target Model=BLIP2-OPT-6.7B2025.12 | 73.15 | 25.1 | 33.85 | 31.5 | 20.5 | 92.6 | 12.64 | |
| PBSFlip Budget=F2, Target Model=BLIP2-OPT-6.7B2025.12 | 57.18 | 37.75 | 45.85 | 42.95 | 21.3 | 94.7 | 13.91 | |
| PBSFlip Budget=F1, Target Model=BLIP2-OPT-6.7B2025.12 | 50.04 | 44.9 | 53.75 | 52.6 | 19.1 | 92.6 | 14.97 | |
| BLADEFlip Budget=F60, Target Model=BLIP2-OPT-6.7B2025.12 | 17.05 | 80.95 | 92.25 | 86.1 | 16.1 | 95.9 | 19.97 | |
| BLADEFlip Budget=F80, Target Model=BLIP2-OPT-6.7B2025.12 | 16.9 | 81.25 | 91.5 | 85.9 | 17.4 | 95.65 | 20.03 | |
| BLADEFlip Budget=F100, Target Model=BLIP2-OPT-6.7B2025.12 | 16.1 | 82.45 | 91.55 | 85.9 | 16.4 | 95.65 | 19.09 | |
| BLADEFlip Budget=F20, Target Model=BLIP2-OPT-6.7B2025.12 | 15.3 | 82.45 | 92.5 | 87.9 | 15.4 | 96.55 | 19.21 | |
| BLADEFlip Budget=F10, Target Model=BLIP2-OPT-6.7B2025.12 | 15 | 82.55 | 92.4 | 86.5 | 16 | 96.1 | 18.83 | |
| BLADEFlip Budget=F4, Target Model=BLIP2-OPT-6.7B2025.12 | 14.8 | 84.25 | 92.75 | 88.05 | 14.5 | 96.2 | 17.64 | |
| RandomFlip Budget=F80, Target Model=BLIP2-OPT-6.7B2025.12 | 14.7 | 83.65 | 91.75 | 88.9 | 14.6 | 95.75 | 12.47 | |
| RandomFlip Budget=F60, Target Model=BLIP2-OPT-6.7B2025.12 | 14.45 | 83.6 | 92.25 | 90.15 | 15.4 | 95.9 | 13.69 | |
| BLADEFlip Budget=F5, Target Model=BLIP2-OPT-6.7B2025.12 | 14.3 | 83.55 | 93 | 87.7 | 15.1 | 96.15 | 18.04 | |
| BLADEFlip Budget=F40, Target Model=BLIP2-OPT-6.7B2025.12 | 14.3 | 84.55 | 92.75 | 88.5 | 15.5 | 96.2 | 16.92 | |
| RandomFlip Budget=F100, Target Model=BLIP2-OPT-6.7B2025.12 | 13.85 | 84.35 | 91.9 | 89.3 | 15.4 | 95.95 | 13.32 | |
| RandomFlip Budget=F1, Target Model=BLIP2-OPT-6.7B2025.12 | 13.75 | 84.1 | 93 | 89.4 | 15.9 | 96.25 | 13.16 | |
| BLADEFlip Budget=F1, Target Model=BLIP2-OPT-6.7B2025.12 | 13.75 | 84.5 | 93 | 88.25 | 14.5 | 96.6 | 17.43 | |
| BLADEFlip Budget=F2, Target Model=BLIP2-OPT-6.7B2025.12 | 13.65 | 84.25 | 93.65 | 88.3 | 13.6 | 96.9 | 17.37 | |
| BLADEFlip Budget=F3, Target Model=BLIP2-OPT-6.7B2025.12 | 13.5 | 84.65 | 92.65 | 88 | 15.1 | 96.6 | 17.37 | |
| RandomFlip Budget=F10, Target Model=BLIP2-OPT-6.7B2025.12 | 13.4 | 84.1 | 92.5 | 89.55 | 14.5 | 96.2 | 12.15 | |
| RandomFlip Budget=F2, Target Model=BLIP2-OPT-6.7B2025.12 | 13.25 | 84.2 | 93 | 89.35 | 15.4 | 96.3 | 12.14 | |
| RandomFlip Budget=F3, Target Model=BLIP2-OPT-6.7B2025.12 | 13.25 | 84.75 | 91.55 | 89.2 | 14.8 | 96.05 | 12.68 | |
| RandomFlip Budget=F20, Target Model=BLIP2-OPT-6.7B2025.12 | 13.1 | 84 | 92.4 | 89.25 | 15.4 | 95.9 | 13.2 | |
| RandomFlip Budget=F5, Target Model=BLIP2-OPT-6.7B2025.12 | 13 | 84.3 | 92.15 | 89 | 14.6 | 96.2 | 13.14 | |
| RandomFlip Budget=F4, Target Model=BLIP2-OPT-6.7B2025.12 | 12.9 | 84.8 | 93.25 | 90.15 | 14.7 | 96.55 | 12.85 | |
| RandomFlip Budget=F40, Target Model=BLIP2-OPT-6.7B2025.12 | 12.45 | 84.55 | 92.15 | 89.5 | 14.8 | 96.15 | 12.71 | |
| AttentionBreakerFlip Budget=F40, Target Model=BLIP2-OPT-6.7B2025.12 | 7.8 | 87.85 | 97.4 | 96.25 | 12.4 | 98.45 | 4.33 | |
| AttentionBreakerFlip Budget=F4, Target Model=BLIP2-OPT-6.7B2025.12 | 7 | 87.65 | 97.5 | 95.05 | 12.4 | 98.55 | 6.17 | |
| AttentionBreakerFlip Budget=F1, Target Model=BLIP2-OPT-6.7B2025.12 | 6.9 | 86.6 | 97.75 | 96.65 | 12.7 | 99 | 3.52 | |
| AttentionBreakerFlip Budget=F10, Target Model=BLIP2-OPT-6.7B2025.12 | 6.85 | 86.35 | 97.5 | 95.75 | 12.1 | 98.45 | 4.9 | |
| AttentionBreakerFlip Budget=F5, Target Model=BLIP2-OPT-6.7B2025.12 | 6.45 | 88.6 | 97.5 | 96.65 | 12.7 | 98.45 | 5.04 | |
| AttentionBreakerFlip Budget=F80, Target Model=BLIP2-OPT-6.7B2025.12 | 5.95 | 84.95 | 98.5 | 97.65 | 12.6 | 99.45 | 4.11 | |
| AttentionBreakerFlip Budget=F100, Target Model=BLIP2-OPT-6.7B2025.12 | 5.95 | 90.05 | 97.25 | 95.15 | 12 | 98.2 | 5.05 | |
| AttentionBreakerFlip Budget=F3, Target Model=BLIP2-OPT-6.7B2025.12 | 5 | 89.1 | 97.75 | 95.85 | 12.2 | 98.85 | 5.43 | |
| AttentionBreakerFlip Budget=F2, Target Model=BLIP2-OPT-6.7B2025.12 | 4.45 | 86.5 | 97.5 | 96.35 | 12.4 | 99.1 | 3.84 | |
| AttentionBreakerFlip Budget=F20, Target Model=BLIP2-OPT-6.7B2025.12 | 4.2 | 90.35 | 98.75 | 96.85 | 12.1 | 99.2 | 3.67 | |
| AttentionBreakerFlip Budget=F60, Target Model=BLIP2-OPT-6.7B2025.12 | 4.15 | 89.2 | 98 | 96.2 | 12 | 99.1 | 4.31 |