Resolving Confusion on CIFAR-10 5-class (test)
19IC Test ErrorSCRUB
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SCRUBBackbone=ResNet2023.02 | 19 | 0 | 19.7 | 0 | |
| RetrainBackbone=All-CNN2023.02 | 19 | 0 | 11.3 | 0 | |
| RetrainBackbone=ResNet2023.02 | 24 | 0 | 18.3 | 0 | |
| SCRUBBackbone=All-CNN2023.02 | 26 | 0 | 18 | 0 | |
| NTKBackbone=All-CNN2023.02 | 36.7 | 3 | 54.3 | 3 | |
| NTKBackbone=ResNet2023.02 | 37.5 | 0 | 52 | 0 | |
| Bad-TBackbone=All-CNN2023.02 | 39.3 | 3 | 25.7 | 1 | |
| NegGrad+Backbone=All-CNN2023.02 | 42.3 | 0 | 62 | 0 | |
| FinetuneBackbone=All-CNN2023.02 | 43.7 | 0 | 67.3 | 0 | |
| EU-kBackbone=ResNet2023.02 | 47 | 8.3 | 63.3 | 3.7 | |
| Bad-TBackbone=ResNet2023.02 | 47.3 | 6 | 27 | 0.3 | |
| NegGrad+Backbone=ResNet2023.02 | 47.5 | 0 | 69 | 0 | |
| CF-kBackbone=All-CNN2023.02 | 47.8 | 0 | 76.3 | 0 | |
| OriginalBackbone=All-CNN2023.02 | 49 | 6 | 80.7 | 6 | |
| FisherBackbone=ResNet2023.02 | 51.5 | 26.3 | 79 | 20 | |
| FinetuneBackbone=ResNet2023.02 | 52 | 0 | 79.3 | 0 | |
| CF-kBackbone=ResNet2023.02 | 54.8 | 0 | 85.3 | 0 | |
| OriginalBackbone=ResNet2023.02 | 56 | 0 | 92 | 0 | |
| FisherBackbone=All-CNN2023.02 | 56.8 | 31.7 | 78.3 | 17.7 | |
| EU-kBackbone=All-CNN2023.02 | 59.5 | 38.3 | 68.7 | 19.7 |