Image Classification on CIFAR100 (test) (Adversarial Robustness Metrics)
84.15Natural AccuracyCalFAT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CalFATAggregation=FedAvg, Label skewness (beta)=0.12022.05 | 84.15 | 48.38 | 42.04 | 31.66 | 41.68 | 32.57 | — | |
| MTBackbone=WRN-28-10, Supervision=Semi-supervised2025.03 | 66.76 | 13.06 | — | 0.08 | 0.09 | 0.01 | 0.03 | |
| StandardBackbone=WRN-28-10, Supervision=Supervised2025.03 | 58.42 | 3.39 | — | 0.01 | 0.02 | 0 | 0 | |
| FedGAIRATAggregation=FedAvg, Label skewness (beta)=0.12022.05 | 58.41 | 38.3 | 36.52 | 31.24 | 31.63 | 19.62 | — | |
| FedTRADESAggregation=FedAvg, Label skewness (beta)=0.12022.05 | 56.96 | 36.92 | 35.15 | 31.08 | 30.37 | 18.67 | — | |
| WSCATBackbone=WRN-28-10, Supervision=Semi-supervised2025.03 | 55.14 | 28.41 | — | 22.99 | 25.26 | 21.87 | 27.43 | |
| FedRBNAggregation=FedAvg, Label skewness (beta)=0.12022.05 | 53.88 | 34.48 | 32.52 | 27.99 | 28.35 | 18.76 | — | |
| PUATBackbone=WRN-28-10, Supervision=Semi-supervised2025.03 | 50.21 | 23.66 | — | 19.18 | 19.43 | 17.41 | 22.4 | |
| RSTBackbone=WRN-28-10, Supervision=Semi-supervised2025.03 | 47.54 | 21.59 | — | 17.58 | 18.39 | 16.56 | 20.92 | |
| RLFATBackbone=WRN-28-10, Supervision=Supervised2025.03 | 41.84 | 15.66 | — | 11.88 | 13.36 | 11.06 | 14.83 | |
| TRADESBackbone=WRN-28-10, Supervision=Supervised2025.03 | 39.17 | 14.64 | — | 12 | 12.79 | 11.31 | 14.54 | |
| WSCAT-supBackbone=WRN-28-10, Supervision=Supervised2025.03 | 39.12 | 17.06 | — | 13.86 | 15.43 | 13.08 | 16.8 | |
| DMATBackbone=WRN-28-10, Supervision=Supervised2025.03 | 37.25 | 10.03 | — | 5.47 | 8.67 | 4.88 | 7.94 | |
| FedMARTAggregation=FedAvg, Label skewness (beta)=0.12022.05 | 19.85 | 19.94 | 19.71 | 14.64 | 16.4 | 14.43 | — | |
| MixFATAggregation=FedAvg, Label skewness (beta)=0.12022.05 | 19.57 | 19.61 | 19.66 | 14.8 | 19.47 | 11.98 | — | |
| FedPGDAggregation=FedAvg, Label skewness (beta)=0.12022.05 | 19.55 | 19.33 | 19.37 | 13.64 | 18.88 | 11.81 | — |