Resolving Confusion on CIFAR-10
15.92Test ErrorSCRUB
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SCRUBBackbone=All-CNN, Confused classes=0, 1, Samples per class=20002023.02 | 15.92 | 0.2 | 87.47 | 14.98 | 0.39 | 54 | 9.67 | |
| SCRUBBackbone=All-CNN, Configuration=Confused class 0,1; 2000-2000 samples2023.02 | 15.92 | 0.2 | 87.47 | 14.98 | 0.39 | 54 | 9.67 | |
| retrainBackbone=All-CNN, Confused classes=0, 1, Samples per class=20002023.02 | 16.43 | 0 | 98.42 | 14.37 | 0 | 23.67 | 0 | |
| retrainBackbone=All-CNN, Configuration=Confused class 0,1; 2000-2000 samples2023.02 | 16.43 | 0 | 98.42 | 14.37 | 0 | 23.67 | 0 | |
| EU-kBackbone=All-CNN, Confused classes=0, 1, Samples per class=20002023.02 | 17.66 | 1.36 | 87.9 | 16.82 | 2.89 | 63.67 | 91.67 | |
| EU-kBackbone=All-CNN, Configuration=Confused class 0,1; 2000-2000 samples2023.02 | 17.66 | 1.36 | 87.9 | 16.82 | 2.89 | 63.67 | 91.67 | |
| SCRUBBackbone=ResNet2023.02 | 18.01 | 0.02 | 95.45 | 15.07 | 0.04 | 30.33 | 0.33 | |
| SCRUBBackbone=ResNet, Confused classes=0, 1, Samples per class=20002023.02 | 18.01 | 0.02 | 95.45 | 15.07 | 0.04 | 30.33 | 0.33 | |
| retrainBackbone=ResNet2023.02 | 18.7 | 0 | 98.57 | 14.78 | 0 | 31.33 | 0 | |
| retrainBackbone=ResNet, Confused classes=0, 1, Samples per class=20002023.02 | 18.7 | 0 | 98.57 | 14.78 | 0 | 31.33 | 0 | |
| finetuneBackbone=All-CNN, Confused classes=0, 1, Samples per class=20002023.02 | 18.72 | 0 | 1.05 | 24.33 | 0 | 223.67 | 0 | |
| finetuneBackbone=All-CNN, Configuration=Confused class 0,1; 2000-2000 samples2023.02 | 18.72 | 0 | 1.05 | 24.33 | 0 | 223.67 | 0 | |
| CF-kBackbone=All-CNN, Confused classes=0, 1, Samples per class=20002023.02 | 19.31 | 0 | 0 | 27.45 | 0 | 294 | 0 | |
| CF-kBackbone=All-CNN, Configuration=Confused class 0,1; 2000-2000 samples2023.02 | 19.31 | 0 | 0 | 27.45 | 0 | 294 | 0 | |
| originalBackbone=All-CNN, Confused classes=0, 1, Samples per class=20002023.02 | 19.95 | 0 | 0 | 30.18 | 0 | 348.67 | 0 | |
| originalBackbone=All-CNN, Configuration=Confused class 0,1; 2000-2000 samples2023.02 | 19.95 | 0 | 0 | 30.18 | 0 | 348.67 | 0 | |
| EU-kBackbone=ResNet2023.02 | 20.03 | 0.25 | 95.55 | 17.85 | 0.18 | 53 | 3.33 | |
| EU-kBackbone=ResNet, Confused classes=0, 1, Samples per class=20002023.02 | 20.03 | 0.25 | 95.55 | 17.85 | 0.18 | 53 | 3.33 | |
| finetuneBackbone=ResNet2023.02 | 20.85 | 0 | 0 | 26.75 | 0 | 255 | 0 | |
| finetuneBackbone=ResNet, Confused classes=0, 1, Samples per class=20002023.02 | 20.85 | 0 | 0 | 26.75 | 0 | 255 | 0 | |
| CF-kBackbone=ResNet2023.02 | 20.93 | 0 | 0 | 27.27 | 0 | 267.33 | 0 | |
| CF-kBackbone=ResNet, Confused classes=0, 1, Samples per class=20002023.02 | 20.93 | 0 | 0 | 27.27 | 0 | 267.33 | 0 | |
| NegGrad+Backbone=All-CNN, Confused classes=0, 1, Samples per class=20002023.02 | 21.74 | 4.48 | 87.65 | 40.05 | 21.8 | 44 | 2.33 | |
| NegGrad+Backbone=All-CNN, Configuration=Confused class 0,1; 2000-2000 samples2023.02 | 21.74 | 4.48 | 87.65 | 40.05 | 21.8 | 44 | 2.33 | |
| originalBackbone=ResNet2023.02 | 21.86 | 0 | 0 | 31.23 | 0 | 356 | 0 | |
| originalBackbone=ResNet, Confused classes=0, 1, Samples per class=20002023.02 | 21.86 | 0 | 0 | 31.23 | 0 | 356 | 0 | |
| NegGrad+Backbone=ResNet2023.02 | 23.41 | 3.87 | 80.07 | 41.08 | 20.29 | 46 | 0.67 | |
| NegGrad+Backbone=ResNet, Confused classes=0, 1, Samples per class=20002023.02 | 23.41 | 3.87 | 80.07 | 41.08 | 20.29 | 46 | 0.67 |