Image Classification Robustness on STL-10 (Adversarial Attacks)
49.9Accuracy (Benign)Lorica
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LoricaBackbone=ViT-T/162025.06 | 49.9 | 43.95 | 42.47 | 44.81 | 44.02 | — | |
| SylvaBackbone=ViT-T/162025.06 | 48.21 | 42.37 | 41.12 | 43.82 | 42.78 | — | |
| FP-Gen-AFFederated Strategy=FedProx, Local Defense=Gen-AF, Backbone=ViT-T/162025.06 | 43.1 | 38.92 | 36.67 | 39.6 | 38.53 | — | |
| Per-LoRABackbone=ViT-T/162025.06 | 43.06 | 38.9 | 36.82 | 39.25 | 38.44 | — | |
| DBFATBackbone=ViT-T/162025.06 | 42.75 | 36.77 | 35.48 | 39.14 | 38.11 | — | |
| FA-Gen-AFFederated Strategy=FedAvg, Local Defense=Gen-AF, Backbone=ViT-T/162025.06 | 42.29 | 36.85 | 35.3 | 37.91 | 36.77 | — | |
| FP-TRADESFederated Strategy=FedProx, Local Defense=TRADES, Backbone=ViT-T/162025.06 | 41.1 | 37.21 | 35.22 | 37 | 36.88 | — | |
| FA-TRADESFederated Strategy=FedAvg, Local Defense=TRADES, Backbone=ViT-T/162025.06 | 40.31 | 35.56 | 34.88 | 37.91 | 37.4 | — | |
| FP-PGD-ATFederated Strategy=FedProx, Local Defense=PGD-AT, Backbone=ViT-T/162025.06 | 34.41 | 36.48 | 35.21 | 39.35 | 37.89 | — | |
| Per-AdvBackbone=ViT-T/162025.06 | 32.92 | 36.83 | 35.01 | 38.25 | 38.01 | — | |
| FA-PGD-ATFederated Strategy=FedAvg, Local Defense=PGD-AT, Backbone=ViT-T/162025.06 | 32.81 | 36.12 | 34.89 | 38.45 | 37.67 | — | |
| CLIPEvaluation Protocol=Zero-shot, Attack Strategy=AutoAttack, Perturbation Budget=1/2552026.01 | — | — | — | — | — | 13.47 | |
| HPT-GPDEvaluation Protocol=Zero-shot, Attack Strategy=AutoAttack, Perturbation Budget=1/2552026.01 | — | — | — | — | — | 59.13 | |
| PMGEvaluation Protocol=Zero-shot, Attack Strategy=AutoAttack, Perturbation Budget=1/2552026.01 | — | — | — | — | — | 40.11 |