List your company
ResearchFormerly WizWand

Backdoor Defense on ImageNet-12 (test)

100ASRNo defense
-3.99303223.00515950.0033577.001541Oct 12, 2022
Updated 8mo ago

Evaluation results

MethodLinks
No defenseAttack method=Trojan-WM2022.1010077.33
No defenseAttack method=BadNet-Grid2022.1099.6774.17
No defenseAttack method=Blend2022.1099.1774.83
No defenseAttack method=Average2022.1096.2174.5
No defenseAttack method=SIG2022.108671.67
NADAttack method=Blend, Clean holdout ratio=10%2022.1033.570.17
NADAttack method=Trojan-WM, Clean holdout ratio=10%2022.1029.3373.33
ABLAttack method=Blend2022.1025.0670.12
NADAttack method=Average, Clean holdout ratio=10%2022.1024.0471.5
NADAttack method=SIG, Clean holdout ratio=10%2022.1019.6770.83
NADAttack method=BadNet-Grid, Clean holdout ratio=10%2022.1013.6771.67
Trap and ReplaceAttack method=Blend, Clean holdout ratio=10%2022.1011.3367.33
ABLAttack method=Average2022.109.8970.82
ABLAttack method=SIG2022.107.6767.01
Trap and ReplaceAttack method=Trojan-WM, Clean holdout ratio=10%2022.107.5270.83
Trap and ReplaceAttack method=Average, Clean holdout ratio=10%2022.106.2172.03
Trap and ReplaceAttack method=SIG, Clean holdout ratio=10%2022.105.3377.33
ABLAttack method=BadNet-Grid2022.103.5974.06
ABLAttack method=Trojan-WM2022.103.2672.08
No defenseAttack=Trojan-WM2022.1010.7733
No defenseAttack=BadNet-Grid2022.100.99670.7417
No defenseAttack=Blend2022.100.99170.7483
No defenseAttack=Average2022.100.96210.745
No defenseAttack=SIG2022.100.860.7167
Trap and ReplaceAttack method=BadNet-Grid, Clean holdout ratio=10%2022.100.6772.64
NADAttack=Blend, Clean holdout ratio=10%2022.100.3350.7017
NADAttack=Trojan-WM, Clean holdout ratio=10%2022.100.29330.7333
ABLAttack=Blend2022.100.25060.7012
NADAttack=Average, Clean holdout ratio=10%2022.100.24040.715
NADAttack=SIG, Clean holdout ratio=10%2022.100.19670.7083
NADAttack=BadNet-Grid, Clean holdout ratio=10%2022.100.13670.7167
T&R (Ours)Attack=Blend, Clean holdout ratio=10%2022.100.11330.6733
ABLAttack=Average2022.100.09890.7082
ABLAttack=SIG2022.100.07670.6701
T&R (Ours)Attack=Trojan-WM, Clean holdout ratio=10%2022.100.07520.7083
T&R (Ours)Attack=Average, Clean holdout ratio=10%2022.100.06210.7203
T&R (Ours)Attack=SIG, Clean holdout ratio=10%2022.100.05330.7733
ABLAttack=BadNet-Grid2022.100.03590.7406
ABLAttack=Trojan-WM2022.100.03260.7208
T&R (Ours)Attack=BadNet-Grid, Clean holdout ratio=10%2022.100.00670.7264