Targeted Adversarial Attack on ImageNet (Multi-Model Evaluation)
88.2VGG-16 ScoreRDI-FTM-E
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RDI-FTM-ESurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 88.2 | 98.1 | 97.1 | 93.4 | 76.7 | 83.4 | 77.1 | 18.4 | 74.9 | 30.1 | 53.4 | 58 | — | — | — | — | |
| RDI-FTM-ESource=RN-50, MI-TI=true, Time (s)=2.922024.11 | 88.1 | 98.3 | 73.4 | 91.4 | 56.9 | 69.3 | 59.4 | — | — | — | — | — | 88.6 | 85.4 | 84.3 | 79.5 | |
| RDI-FTMSurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 87.5 | 97.8 | 96.7 | 92.4 | 75.4 | 81.7 | 74 | 14.5 | 71 | 25.2 | 49.3 | 54.4 | — | — | — | — | |
| RDI-FTMSource=RN-50, MI-TI=true, Time (s)=1.542024.11 | 86.3 | 97.9 | 70.8 | 89.7 | 54.7 | 66.6 | 56.1 | — | — | — | — | — | 87.5 | 83.3 | 81.2 | 77.4 | |
| RDI-CFMSurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 86.1 | 98.3 | 97 | 92.1 | 71.7 | 79.9 | 72 | 10.3 | 66.5 | 20.3 | 41.9 | 45.8 | — | — | — | — | |
| RDI-CFMSource=RN-50, MI-TI=true, Time (s)=1.392024.11 | 84.7 | 98.4 | 65.5 | 90.3 | 48 | 59.3 | 51.1 | — | — | — | — | — | 88.4 | 81.5 | 78.8 | 74.6 | |
| RDI-FTM-ESurrogate=DN-121, Combined with=MI-TI2024.11 | 79.5 | 87.6 | 64.6 | 98 | 48.7 | 60.1 | 47.6 | 4.2 | 43.4 | 8.9 | 24.4 | 26.7 | — | — | — | — | |
| ODISource=RN-50, MI-TI=true, Time (s)=4.382024.11 | 78.3 | 97.6 | 65.9 | 87 | 49.5 | 55.4 | 43.8 | — | — | — | — | — | 77.1 | 67.3 | 70 | 69.2 | |
| RDI-FTMSurrogate=DN-121, Combined with=MI-TI2024.11 | 77.3 | 85.6 | 62.8 | 98.2 | 46.9 | 58.4 | 46 | 3.7 | 40 | 8.2 | 21.6 | 26.5 | — | — | — | — | |
| RDI-CFMSurrogate=DN-121, Combined with=MI-TI2024.11 | 76.2 | 83.9 | 56.1 | 97.8 | 43.6 | 53.8 | 41.1 | 3.6 | 32.8 | 6.4 | 17.3 | 21.1 | — | — | — | — | |
| RDI-AdmixSource=RN-50, MI-TI=true, Time (s)=3.552024.11 | 74.2 | 98.7 | 42.7 | 86.8 | 26.7 | 34.1 | 20.9 | — | — | — | — | — | 80.7 | 59.4 | 56.1 | 58 | |
| RDI-AdmixSurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 72.9 | 98.4 | 99.1 | 88 | 46.3 | 58.3 | 36.5 | 1.8 | 33.4 | 4.5 | 15.4 | 17.1 | — | — | — | — | |
| RDI-ODISurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 70.9 | 94 | 96.1 | 83.4 | 65.4 | 69.9 | 57.6 | 9.1 | 52.9 | 18.6 | 28.6 | 42.8 | — | — | — | — | |
| RDI-SISource=RN-50, MI-TI=true, Time (s)=5.952024.11 | 70.5 | 98.8 | 56.4 | 88.9 | 37.9 | 43.6 | 29.5 | — | — | — | — | — | 79.8 | 56.2 | 66.2 | 62.8 | |
| RDI-SISurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 70.1 | 98 | 98.9 | 89.3 | 53.3 | 57.3 | 40 | 4.5 | 40.7 | 8.8 | 21.4 | 27.4 | — | — | — | — | |
| RDI-VTSource=RN-50, MI-TI=true, Time (s)=7.162024.11 | 68.8 | 98.2 | 45.8 | 82.5 | 32.8 | 37.9 | 27.9 | — | — | — | — | — | 78.7 | 54.5 | 56.1 | 58.3 | |
| RDI-SUSource=RN-50, MI-TI=true, Time (s)=2.212024.11 | 67.9 | 98.3 | 32.1 | 83.3 | 20.9 | 26.2 | 24.9 | — | — | — | — | — | 74.7 | 56.3 | 50.2 | 53.5 | |
| RDISurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 66.9 | 98.4 | 98.7 | 83.1 | 35.6 | 42.5 | 25.4 | 0.8 | 22.4 | 3.2 | 9.8 | 10.8 | — | — | — | — | |
| RDI-VTSurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 66.4 | 98.4 | 98.8 | 83.1 | 51.6 | 56.6 | 40.7 | 5 | 39.6 | 8.4 | 21.6 | 22.7 | — | — | — | — | |
| RDISource=RN-50, MI-TI=true, Time (s)=1.232024.11 | 66.3 | 98.2 | 29.9 | 81.9 | 17.1 | 23.3 | 13.2 | — | — | — | — | — | 70.7 | 46.4 | 47.2 | 49.4 | |
| RDI-ODISurrogate=DN-121, Combined with=MI-TI2024.11 | 64.2 | 71.7 | 52.8 | 98 | 39.8 | 45.9 | 31.4 | 3.3 | 26.9 | 7.4 | 14.7 | 21.9 | — | — | — | — | |
| DISurrogate Ensemble=RN-50 + Inc-v3, Combined with=MI-TI2024.11 | 63.5 | 99 | 99.2 | 77 | 16.6 | 24 | 12.5 | 0.2 | 7.3 | 0.7 | 3.1 | 2.6 | — | — | — | — | |
| DISource=RN-50, MI-TI=true, Time (s)=1.372024.11 | 63.2 | 98.9 | 9 | 74.7 | 5.6 | 9.4 | 5.5 | — | — | — | — | — | 56.4 | 27.8 | 29 | 37.9 | |
| RDI-AdmixSurrogate=DN-121, Combined with=MI-TI2024.11 | 53.2 | 67.6 | 31.1 | 98.3 | 20.1 | 26.5 | 17.8 | 1 | 14.7 | 1.7 | 6.8 | 7.4 | — | — | — | — | |
| RDI-FTM-ESurrogate=LeViT, Combined with=MI-TI2024.11 | 50.1 | 52.4 | 62.8 | 63.1 | 48.4 | 53.2 | 49.2 | 40.3 | 99.9 | 72.2 | 86.2 | 93 | — | — | — | — | |
| RDI-AdmixSSurrogate=DN-121, Combined with=MI-TI2024.11 | 49.6 | 65.3 | 41 | 98.6 | 28.9 | 34.3 | 21.6 | 2.4 | 21.8 | 3.4 | 10.5 | 14.2 | — | — | — | — | |
| RDI-VTSurrogate=DN-121, Combined with=MI-TI2024.11 | 47.7 | 62.1 | 31.5 | 98.6 | 25.4 | 27.2 | 20.3 | 2.2 | 19.2 | 3.5 | 8.3 | 11.7 | — | — | — | — | |
| RDI-SISurrogate=DN-121, Combined with=MI-TI2024.11 | 45.4 | 60.1 | 34.3 | 98.6 | 22 | 25.8 | 16.1 | 2 | 16.1 | 2.4 | 8.2 | 11.7 | — | — | — | — | |
| RDISurrogate=DN-121, Combined with=MI-TI2024.11 | 42.1 | 55.7 | 20.8 | 98.5 | 12.8 | 18.8 | 10.1 | 0.8 | 8.5 | 1.3 | 3.7 | 4.5 | — | — | — | — | |
| RDI-FTMSurrogate=LeViT, Combined with=MI-TI2024.11 | 41.3 | 41.9 | 56.9 | 54.2 | 39.8 | 46.5 | 42.2 | 31.1 | 99.9 | 63.2 | 77.5 | 86.7 | — | — | — | — | |
| DISurrogate=DN-121, Combined with=MI-TI2024.11 | 37.1 | 44.4 | 7.1 | 98.7 | 4.3 | 8.3 | 5.2 | 0.2 | 3 | 0.4 | 1 | 1.1 | — | — | — | — | |
| RDI-CFMSurrogate=LeViT, Combined with=MI-TI2024.11 | 27.3 | 30.3 | 39.8 | 39 | 23.6 | 30.1 | 27.2 | 18.4 | 100 | 45.5 | 63.8 | 75.7 | — | — | — | — | |
| RDI-ODISurrogate=LeViT, Combined with=MI-TI2024.11 | 21 | 25 | 40.9 | 38.3 | 25.7 | 31.2 | 26.3 | 15.3 | 98.7 | 34.1 | 43.8 | 66.1 | — | — | — | — | |
| RDI-AdmixSurrogate=LeViT, Combined with=MI-TI2024.11 | 6.5 | 8.3 | 9.9 | 8.8 | 5.8 | 7.2 | 5.5 | 3.3 | 100 | 10.7 | 23.3 | 30.9 | — | — | — | — | |
| RDI-AdmixSSurrogate=LeViT, Combined with=MI-TI2024.11 | 5.3 | 8.1 | 13.9 | 12.4 | 9.9 | 8.4 | 7.2 | 8 | 99.9 | 20.6 | 30 | 47.2 | — | — | — | — | |
| RDI-VTSurrogate=LeViT, Combined with=MI-TI2024.11 | 5.3 | 7.2 | 12 | 10.1 | 8.3 | 8.8 | 8.9 | 6.3 | 99.9 | 18.7 | 27.2 | 40.5 | — | — | — | — | |
| RDI-SISurrogate=LeViT, Combined with=MI-TI2024.11 | 3.4 | 6.3 | 10.6 | 10 | 6.4 | 5.4 | 5.1 | 4.3 | 100 | 18.1 | 24.1 | 38.4 | — | — | — | — | |
| RDISurrogate=LeViT, Combined with=MI-TI2024.11 | 3 | 3.5 | 5.4 | 4.1 | 3.6 | 4.6 | 2.3 | 1.1 | 100 | 7.9 | 13.8 | 22.1 | — | — | — | — | |
| DISurrogate=LeViT, Combined with=MI-TI2024.11 | 1.6 | 2.5 | 4.2 | 2.7 | 1.8 | 2.6 | 2.3 | 0.6 | 100 | 4.2 | 9.3 | 10.3 | — | — | — | — |