Image Classification on MNIST (ACC, ASR)
99.28AccuracyState 0 (uninfected)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| State 0 (uninfected)Model=Inception, Learning Mode=std2024.09 | 99.28 | 0.04 | |
| State 0 (uninfected)Model=ResNet, Learning Mode=std2024.09 | 99.25 | 0.03 | |
| State 1 (infected)Model=ResNet, Learning Mode=adv2024.09 | 99.25 | 100 | |
| State 1 (infected)Model=VGG, Learning Mode=adv2024.09 | 99.2 | 100 | |
| State 0 (uninfected)Model=VGG, Learning Mode=std2024.09 | 99.16 | 0 | |
| State 1 (infected)Model=Inception, Learning Mode=adv2024.09 | 99.12 | 100 | |
| State 1 (infected)Model=VGG, Learning Mode=std2024.09 | 99.08 | 100 | |
| State 1 (infected)Model=ResNet, Learning Mode=std2024.09 | 99.08 | 100 | |
| State 1 (infected)Model=Inception, Learning Mode=std2024.09 | 99.05 | 100 | |
| State 0 (uninfected)Model=ResNet, Learning Mode=adv2024.09 | 98.92 | 0.02 | |
| State 0 (uninfected)Model=VGG, Learning Mode=adv2024.09 | 98.9 | 0 | |
| State 0 (uninfected)Model=Inception, Learning Mode=adv2024.09 | 98.87 | 0.03 | |
| Fine-TuningModel=Inception, Learning Mode=adv2024.09 | 98.12 | 100 | |
| Neural CleanseModel=VGG, Learning Mode=std2024.09 | 98.07 | 0.18 | |
| Pixel BackdoorModel=Inception, Learning Mode=adv2024.09 | 97.92 | 2.83 | |
| TaborModel=VGG, Learning Mode=std2024.09 | 97.87 | 0.12 | |
| Psycho-PassModel=VGG, Learning Mode=std2024.09 | 97.78 | 0.32 | |
| Neural CleanseModel=Inception, Learning Mode=adv2024.09 | 97.62 | 45.94 | |
| Neural CleanseModel=Inception, Learning Mode=std2024.09 | 97.51 | 0.03 | |
| Psycho-PassModel=Inception, Learning Mode=adv2024.09 | 97.32 | 0.12 | |
| TaborModel=Inception, Learning Mode=adv2024.09 | 97.31 | 23.07 | |
| Neural CleanseModel=ResNet, Learning Mode=std2024.09 | 97.17 | 25.3 | |
| Pixel BackdoorModel=VGG, Learning Mode=adv2024.09 | 97.08 | 0.03 | |
| Pixel BackdoorModel=VGG, Learning Mode=std2024.09 | 96.97 | 2.31 | |
| TaborModel=Inception, Learning Mode=std2024.09 | 96.88 | 0.44 | |
| Pixel BackdoorModel=Inception, Learning Mode=std2024.09 | 96.83 | 2.24 | |
| Neural CleanseModel=VGG, Learning Mode=adv2024.09 | 96.79 | 0.56 | |
| Psycho-PassModel=VGG, Learning Mode=adv2024.09 | 96.65 | 0.27 | |
| Fine-TuningModel=ResNet, Learning Mode=std2024.09 | 96.44 | 98.36 | |
| Psycho-PassModel=ResNet, Learning Mode=std2024.09 | 96.39 | 2.93 | |
| Pixel BackdoorModel=ResNet, Learning Mode=adv2024.09 | 96.36 | 25.19 | |
| Psycho-PassModel=Inception, Learning Mode=std2024.09 | 96.3 | 0.88 | |
| Neural CleanseModel=ResNet, Learning Mode=adv2024.09 | 96.25 | 26.02 | |
| Fine-TuningModel=ResNet, Learning Mode=adv2024.09 | 96.2 | 89.7 | |
| TaborModel=VGG, Learning Mode=adv2024.09 | 96.19 | 5.44 | |
| TaborModel=ResNet, Learning Mode=adv2024.09 | 95.96 | 58.2 | |
| Pixel BackdoorModel=ResNet, Learning Mode=std2024.09 | 95.92 | 5.36 | |
| UnicornModel=ResNet, Learning Mode=adv2024.09 | 95.64 | 0.67 | |
| Fine-TuningModel=VGG, Learning Mode=std2024.09 | 95.53 | 100 | |
| UnicornModel=VGG, Learning Mode=std2024.09 | 95.53 | 0.1 | |
| TaborModel=ResNet, Learning Mode=std2024.09 | 95.51 | 32.99 | |
| Psycho-PassModel=ResNet, Learning Mode=adv2024.09 | 95.31 | 0.33 | |
| UnicornModel=Inception, Learning Mode=adv2024.09 | 95.04 | 1.08 | |
| UnicornModel=ResNet, Learning Mode=std2024.09 | 94.64 | 15.49 | |
| UnicornModel=Inception, Learning Mode=std2024.09 | 94.57 | 0.65 | |
| Fine-TuningModel=VGG, Learning Mode=adv2024.09 | 94.54 | 100 | |
| UnicornModel=VGG, Learning Mode=adv2024.09 | 93.15 | 9.03 | |
| Fine-TuningModel=Inception, Learning Mode=std2024.09 | 90.86 | 58.46 |