Resolving Confusion (RC) on CIFAR-5
22.6Test Error (mean)CF-k
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CF-kBackbone=ResNet, Scale=Small-scale2023.02 | 22.6 | — | 0 | — | 0 | — | — | — | — | — | — | — | — | — | |
| EU-kBackbone=ResNet, Scale=Small-scale2023.02 | 23.5 | — | 0 | — | 10.7 | — | — | — | — | — | — | — | — | — | |
| OriginalBackbone=ResNet, Scale=Small-scale2023.02 | 24.2 | — | 0 | — | 0 | — | — | — | — | — | — | — | — | — | |
| SCRUBBackbone=ResNet, Scale=Small-scale2023.02 | 24.2 | — | 0 | — | 40.8 | — | — | — | — | — | — | — | — | — | |
| FinetuneBackbone=ResNet, Scale=Small-scale2023.02 | 24.3 | — | 0 | — | 0 | — | — | — | — | — | — | — | — | — | |
| RetrainBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 24.4 | 2.75 | 0 | 0 | 90.67 | 4.04 | 19 | 1.32 | 0 | 0 | 11.33 | 4.62 | 0 | 0 | |
| NTKBackbone=ResNet, Scale=Small-scale2023.02 | 24.4 | — | 0 | — | 22.4 | — | — | — | — | — | — | — | — | — | |
| RetrainBackbone=ResNet, Scale=Small-scale2023.02 | 24.9 | — | 0 | — | 28.8 | — | — | — | — | — | — | — | — | — | |
| SCRUBBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 25 | 3.14 | 0 | 0 | 93.33 | 2.52 | 26 | 4.44 | 0 | 0 | 18 | 11.14 | 0 | 0 | |
| NegGrad+Backbone=ResNet, Scale=Small-scale2023.02 | 25.5 | — | 0 | — | 41.3 | — | — | — | — | — | — | — | — | — | |
| Bad-TBackbone=ResNet, Scale=Small-scale2023.02 | 27.73 | — | 5.12 | — | 8 | — | — | — | — | — | — | — | — | — | |
| FisherBackbone=ResNet, Scale=Small-scale2023.02 | 31.6 | — | 14 | — | 4.8 | — | — | — | — | — | — | — | — | — | |
| NTKBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 32.2 | 2.84 | 0.75 | 1.3 | 43.33 | 14.15 | 36.67 | 4.07 | 3 | 5.2 | 54.33 | 9.02 | 3 | 5.2 | |
| NegGrad+Backbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 33.53 | 4.47 | 0 | 0 | 13.33 | 21.36 | 42.33 | 11.34 | 0 | 0 | 62 | 22.65 | 0 | 0 | |
| FinetuneBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 34.33 | 3.35 | 0 | 0 | 3 | 5.2 | 49 | 4.77 | 0 | 0 | 67.33 | 16.04 | 0 | 0 | |
| CF-kBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 36.13 | 4.21 | 0 | 0 | 0.33 | 0.58 | 47.83 | 5.8 | 0 | 0 | 76.33 | 14.43 | 0 | 0 | |
| OriginalBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 37.07 | 4.67 | 1.5 | 2.6 | 5.67 | 9.81 | 50 | 5.7 | 6 | 10.39 | 80.67 | 12.58 | 6 | 10.39 | |
| EU-kBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 51.6 | 1 | 27.67 | 3.5 | 52.67 | 6.03 | 59.5 | 5.22 | 38.33 | 6.66 | 68.67 | 15.57 | 19.67 | 10.41 | |
| FisherBackbone=All-CNN, Confused classes=0, 1, Samples=50-502023.02 | 51.93 | 2.95 | 35.17 | 3.92 | 31 | 11.53 | 56.83 | 8.69 | 31.67 | 14.01 | 78.33 | 15.53 | 17.67 | 11.5 |