Adversarial Attack on MS-COCO (test)
89.5Classification AccuracyMMAS
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MMASTarget Model=Flamingo, config=Full2026.05 | 89.5 | 87.7 | 89.2 | 91.6 | 89.5 | |
| MMASTarget Model=LLaVA, config=Full2026.05 | 88.4 | 89.5 | 85.7 | 89.5 | 88.3 | |
| MMASTarget Model=MiniGPT-4, config=Full2026.05 | 87.6 | 89.2 | 88.4 | 92.3 | 89.4 | |
| MMASAttack=universal, Target Model=OpenFlamingo2026.05 | 86 | 78 | 95 | 99 | 89 | |
| MMASTarget Model=BLIP-2, config=Full2026.05 | 84.9 | 79.6 | 85.4 | 89.7 | 84.9 | |
| TA-UAPTarget Model=Flamingo2026.05 | 84.7 | 80.5 | 83.1 | 84.3 | 83.2 | |
| TA-UAPTarget Model=LLaVA2026.05 | 83.4 | 84.5 | 80.7 | 84.5 | 83.3 | |
| TA-UAPTarget Model=MiniGPT-42026.05 | 82.6 | 84.2 | 83.4 | 87.3 | 84.4 | |
| TC-UAPTarget Model=Flamingo2026.05 | 81 | 78.8 | 81.9 | 83 | 81.2 | |
| TC-UAPTarget Model=LLaVA2026.05 | 80.4 | 81.5 | 77.7 | 81.5 | 80.3 | |
| TA-UAPTarget Model=BLIP-22026.05 | 79.9 | 74.6 | 80.4 | 84.7 | 79.9 | |
| TC-UAPTarget Model=MiniGPT-42026.05 | 79.6 | 81.2 | 80.4 | 84.3 | 81.4 | |
| TC-UAPTarget Model=BLIP-22026.05 | 76.9 | 71.6 | 77.4 | 81.7 | 76.9 | |
| CroPAAttack=white-box, Target Model=OpenFlamingo2026.05 | 75 | 72 | 90 | 96 | 83 | |
| CleanTarget Model=BLIP-22026.05 | 41.3 | 42.2 | 48.7 | 52.6 | 46.2 | |
| CleanTarget Model=Flamingo2026.05 | 41.2 | 42.7 | 44.9 | 48.3 | 44.3 | |
| CleanTarget Model=MiniGPT-42026.05 | 38.6 | 40.1 | 42.1 | 44 | 41.2 | |
| CleanTarget Model=LLaVA2026.05 | 31.6 | 42.3 | 32.7 | 35.8 | 35.6 |