Adversarial Robustness on MNIST (Image Classification)
99.64Clean AccuracyUndefended
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| UndefendedBackbone=NiN2022.02 | 99.64 | — | 98.86 | |
| ACBackbone=NiN2022.02 | 99.6 | — | 0.03 | |
| UndefendedBackbone=ResNet182022.02 | 99.57 | — | 99.49 | |
| NONEBackbone=NiN2022.02 | 99.42 | — | 0.03 | |
| ACBackbone=ResNet182022.02 | 99.35 | — | 0.03 | |
| NADBackbone=NiN2022.02 | 99.24 | — | 0.09 | |
| ABLBackbone=VGG112022.02 | 99.21 | — | 98.51 | |
| NADBackbone=ResNet182022.02 | 99.19 | — | 0.19 | |
| NONEBackbone=ResNet182022.02 | 99.09 | — | 0.2 | |
| NADBackbone=VGG112022.02 | 99.06 | — | 32.06 | |
| UndefendedBackbone=VGG112022.02 | 99.05 | — | 98.99 | |
| ABLBackbone=ResNet182022.02 | 99.01 | — | 98.81 | |
| MarksmanPoisoning rate=50%2022.10 | 98.8 | 0.1 | 100 | |
| NONEBackbone=VGG112022.02 | 98.63 | — | 0.11 | |
| ABLBackbone=NiN2022.02 | 98.4 | — | 89.32 | |
| MarksmanPoisoning Rate=10%2022.10 | 98.3 | 0.6 | 100 | |
| SecureSplitAttack=Fu attack2026.01 | 98 | — | 3 | |
| RefoolMTPoisoning Rate=10%2022.10 | 97.7 | 1.2 | 34.1 | |
| ACBackbone=VGG112022.02 | 97.59 | — | 0.1 | |
| PatchMTPoisoning Rate=10%2022.10 | 97.5 | 1.4 | 29.8 | |
| DP-SGDBackbone=VGG112022.02 | 97.17 | — | 0.41 | |
| WaNetMTPoisoning rate=50%2022.10 | 97 | 1.9 | 90.9 | |
| No defenseAttack=VILLAIN attack2026.01 | 97 | — | 92 | |
| No defenseAttack=Fu attack2026.01 | 97 | — | 94 | |
| MPAttack=Fu attack2026.01 | 97 | — | 62 | |
| SecureSplitAttack=BadVFL attack2026.01 | 97 | — | 3 | |
| SecureSplitAttack=He attack2026.01 | 97 | — | 4 | |
| SecureSplitAttack=Adaptive attack2026.01 | 97 | — | 5 | |
| WaNetMTPoisoning Rate=10%2022.10 | 96.9 | 2 | 78.4 | |
| DP-SGDBackbone=ResNet182022.02 | 96.81 | — | 0.38 | |
| PatchMTPoisoning rate=50%2022.10 | 96.7 | 2.2 | 99.6 | |
| DPAttack=VILLAIN attack2026.01 | 96 | — | 72 | |
| SecureSplitAttack=VILLAIN attack2026.01 | 96 | — | 2 | |
| DPAttack=BadVFL attack2026.01 | 96 | — | 35 | |
| ANPAttack=VILLAIN attack2026.01 | 95 | — | 62 | |
| DPAttack=Fu attack2026.01 | 95 | — | 92 | |
| RefoolMTPoisoning rate=50%2022.10 | 94.2 | 4.7 | 89.3 | |
| MPAttack=VILLAIN attack2026.01 | 94 | — | 75 | |
| VFLIPAttack=VILLAIN attack2026.01 | 94 | — | 8 | |
| ANPAttack=Fu attack2026.01 | 94 | — | 48 | |
| No defenseAttack=BadVFL attack2026.01 | 94 | — | 70 | |
| MPAttack=BadVFL attack2026.01 | 94 | — | 49 | |
| ANPAttack=BadVFL attack2026.01 | 94 | — | 17 | |
| HDBSCANAttack=He attack2026.01 | 94 | — | 75 | |
| DPAttack=He attack2026.01 | 94 | — | 51 | |
| No defenseAttack=Adaptive attack2026.01 | 94 | — | 94 | |
| DP-SGDBackbone=NiN2022.02 | 93.02 | — | 1.1 | |
| HDBSCANAttack=BadVFL attack2026.01 | 93 | — | 59 | |
| No defenseAttack=He attack2026.01 | 93 | — | 89 | |
| HDBSCANAttack=VILLAIN attack2026.01 | 92 | — | 74 | |
| VFLIPAttack=Fu attack2026.01 | 92 | — | 7 | |
| VFLIPAttack=BadVFL attack2026.01 | 92 | — | 11 | |
| MPAttack=He attack2026.01 | 92 | — | 57 | |
| HDBSCANAttack=Adaptive attack2026.01 | 92 | — | 94 | |
| ANPAttack=Adaptive attack2026.01 | 92 | — | 68 | |
| TrMeanAttack=VILLAIN attack2026.01 | 91 | — | 72 | |
| Multi-KrumAttack=BadVFL attack2026.01 | 91 | — | 33 | |
| DPAttack=Adaptive attack2026.01 | 90 | — | 94 | |
| VFLIPAttack=Adaptive attack2026.01 | 90 | — | 19 | |
| HDBSCANAttack=Fu attack2026.01 | 89 | — | 80 | |
| TrMeanAttack=He attack2026.01 | 89 | — | 64 | |
| MPAttack=Adaptive attack2026.01 | 89 | — | 81 | |
| TrMeanAttack=Fu attack2026.01 | 88 | — | 63 | |
| TrMeanAttack=BadVFL attack2026.01 | 88 | — | 42 | |
| Multi-KrumAttack=VILLAIN attack2026.01 | 87 | — | 59 | |
| ANPAttack=He attack2026.01 | 87 | — | 39 | |
| TrMeanAttack=Adaptive attack2026.01 | 87 | — | 90 | |
| VFLIPAttack=He attack2026.01 | 85 | — | 12 | |
| Multi-KrumAttack=Adaptive attack2026.01 | 84 | — | 65 | |
| Multi-KrumAttack=Fu attack2026.01 | 82 | — | 55 | |
| Multi-KrumAttack=He attack2026.01 | 82 | — | 52 |