Image Classification on CIFAR10C level 1-5
8.1Error RateRMT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RMTSource-free=false, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 8.1 | — | — | — | — | — | |
| RMTSource-free=false, Updates=4, Test-time adaptation protocol=Gradual2022.11 | 8.6 | — | — | — | — | — | |
| RMTSource-free=true, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 9.3 | — | — | — | — | — | |
| CoTTASource-free=true, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 10.9 | — | — | — | — | — | |
| GTTA-MIXSource-free=false, Updates=4, Test-time adaptation protocol=Gradual2022.11 | 11.8 | — | — | — | — | — | |
| AdaContrastSource-free=false, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 12.1 | — | — | — | — | — | |
| BN-1Source-free=true, Updates=-, Test-time adaptation protocol=Gradual2022.11 | 13.7 | — | — | — | — | — | |
| TENT-cont.Source-free=true, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 20.4 | — | — | — | — | — | |
| RMTSource-free=false, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 23.6 | — | — | — | — | — | |
| RMTSource-free=false, Updates=4, Test-time adaptation protocol=Gradual2022.11 | 24.2 | — | — | — | — | — | |
| SourceSource-free=true, Updates=-, Test-time adaptation protocol=Gradual2022.11 | 24.7 | — | — | — | — | — | |
| GTTA-MIXSource-free=false, Updates=4, Test-time adaptation protocol=Gradual2022.11 | 24.7 | — | — | — | — | — | |
| CoTTASource-free=true, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 26.3 | — | — | — | — | — | |
| RMTSource-free=true, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 26.4 | — | — | — | — | — | |
| BN-1Source-free=true, Updates=-, Test-time adaptation protocol=Gradual2022.11 | 29.9 | — | — | — | — | — | |
| AdaContrastSource-free=false, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 33 | — | — | — | — | — | |
| SourceSource-free=true, Updates=-, Test-time adaptation protocol=Gradual2022.11 | 33.6 | — | — | — | — | — | |
| TENT-cont.Source-free=true, Updates=1, Test-time adaptation protocol=Gradual2022.11 | 74.8 | — | — | — | — | — | |
| Dropout (SE1)Backbone=ResNet-20-FRN2022.12 | — | 76.32 | 0.713 | 6.4 | 83.1 | 16.4 | |
| HMC 3-chainsBackbone=ResNet-20-FRN, Configuration=3-chains2022.12 | — | 71.05 | 0.879 | 7.9 | 100 | 0 | |
| Multi SWABackbone=ResNet-20-FRN2022.12 | — | 77.43 | 0.69 | 5.8 | 80.2 | 20.9 | |
| Regular EnsembleBackbone=ResNet-20-FRN2022.12 | — | 78.48 | 0.647 | 4.2 | 79.8 | 20.6 |