Image Classification on Flowers102 (Accuracy and Robustness Metrics)
84.92Robustness ScoreATAC
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ATACAttack Type=Carlini–Wagner, Attack Budget (epsilon)=4/2552025.11 | 84.92 | 65.34 | |
| ATACAttack Type=AutoAttack, Attack Budget (epsilon)=4/2552025.11 | 64.79 | 65.34 | |
| ATACAttack Type=AutoAttack, Attack Budget (epsilon)=1/2552025.11 | 64.12 | 65.34 | |
| ATACmode=Test-time Defense, attack=10-step PGD, epsilon=1/2552025.11 | 54.74 | 65.34 | |
| R-TPTmode=Test-time Defense, attack=10-step PGD, epsilon=1/2552025.11 | 52.07 | 62.92 | |
| ATACAttack Type=Carlini–Wagner, Attack Budget (epsilon)=1/2552025.11 | 48.77 | 65.34 | |
| TTCmode=Test-time Defense, attack=10-step PGD, epsilon=1/2552025.11 | 39.14 | 64.16 | |
| TTEmode=Test-time Defense, attack=10-step PGD, epsilon=1/2552025.11 | 35.88 | 65.18 | |
| PMG-AFTmode=Adversarial Finetuning, attack=10-step PGD, epsilon=1/2552025.11 | 23.43 | 37 | |
| TeCoAmode=Adversarial Finetuning, attack=10-step PGD, epsilon=1/2552025.11 | 21.94 | 36.8 | |
| FAREmode=Adversarial Finetuning, attack=10-step PGD, epsilon=1/2552025.11 | 17.14 | 47.98 | |
| No DefenseAttack Type=Carlini–Wagner, Attack Budget (epsilon)=1/2552025.11 | 1.51 | 65.56 | |
| CLIPattack=10-step PGD, epsilon=1/2552025.11 | 1.14 | 65.46 | |
| CLIP-FTmode=Adversarial Finetuning, attack=10-step PGD, epsilon=1/2552025.11 | 0.54 | 53.37 | |
| No DefenseAttack Type=AutoAttack, Attack Budget (epsilon)=1/2552025.11 | 0.02 | 65.56 | |
| No DefenseAttack Type=AutoAttack, Attack Budget (epsilon)=4/2552025.11 | 0.02 | 65.56 | |
| No DefenseAttack Type=Carlini–Wagner, Attack Budget (epsilon)=4/2552025.11 | 0 | 65.56 |