Classification on 16-dataset Robustness Suite (Zero-shot, test)
20.56Tiny-ImageNet Zero-Shot AccComp-TGA
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Comp-TGAZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 20.56 | 14.17 | 5.45 | 41.28 | 1.25 | 1.98 | 9.24 | 1.4 | 48 | 0 | 0 | 2.39 | 23.25 | 16.2 | 10 | 0 | 8.61 | |
| LAATZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 15.06 | 20.55 | 6.25 | 55.33 | 0.66 | 0.8 | 5.67 | 0.24 | 96 | 4 | 0 | 1.11 | 15.32 | 10.9 | 3 | 2.93 | 8.49 | |
| TGA-ZSRZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 13.13 | 5.76 | 2.49 | 33.59 | 0.74 | 1.07 | 5.86 | 0.98 | 21 | 0 | 0 | 1.59 | 17.41 | 12.34 | 5 | 0 | 5.95 | |
| FT-CleanZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 10.76 | 16.2 | 4.38 | 34.4 | 0.19 | 0.4 | 1.72 | 0.21 | 0 | 3 | 0 | 0.23 | 11.66 | 6.53 | 0 | 0 | 5.42 | |
| FT-Adv.Zero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 5.56 | 1.53 | 1.32 | 13.48 | 0.06 | 0.02 | 0.57 | 0.11 | 48 | 0 | 0 | 0.11 | 8.43 | 3.43 | 0 | 0.16 | 2.2 | |
| FAREZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 5.14 | 2.26 | 0.61 | 15.36 | 0.14 | 1.33 | 1.85 | 0.2 | 0 | 0 | 0 | 0.23 | 9.28 | 5.74 | 3 | 0 | 2.64 | |
| TeCoAZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 1.56 | 0.32 | 0.21 | 9.46 | 0.06 | 0.1 | 0.93 | 0.15 | 21 | 0 | 0 | 0.17 | 9.34 | 3.94 | 1 | 0.04 | 1.66 | |
| PMG-AFTZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 0.43 | 0.15 | 0.04 | 3.98 | 0.03 | 0.02 | 0 | 0.03 | 80 | 0 | 0 | 0.05 | 5.09 | 1.63 | 1 | 0.09 | 0.82 | |
| CLIPZero-shot evaluation protocol=true, PGD attack strength (epsilon)=8/2552026.03 | 0.22 | 1.55 | 0.02 | 14.03 | 0.22 | 4.88 | 1.8 | 0.34 | 0 | 0 | 0 | 0.36 | 9.29 | 5.83 | 9 | 0 | 2.42 |