Adaptation Performance on CIFAR-10-C against Corruption Benchmarks
83.6Accuracy (Noise)STAMP + Hi-Vec
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| STAMP + Hi-VecBackbone=ResNet-182025.08 | 83.6 | 91.4 | 87.3 | 85.7 | 82.7 | 84.2 | 84.3 | 86.9 | 85.5 | 86.5 | 81.1 | 83.7 | |
| STAMP + Hi-VecBackbone=ResNet-182025.08 | 83.6 | 91.4 | 87.3 | 85.7 | 82.7 | 84.2 | 84.3 | 86.9 | 85.5 | 86.5 | 81.1 | 83.7 | |
| Tent + Hi-VecBackbone=ResNet-182025.08 | 80.7 | 63 | 70.5 | 81.7 | 55.4 | 66 | 81.7 | 62.8 | 71 | 82.5 | 65.8 | 73.2 | |
| Tent + Hi-VecBackbone=ResNet-182025.08 | 80.7 | 63 | 70.5 | 81.7 | 55.4 | 66 | 81.7 | 62.8 | 71 | 82.5 | 65.8 | 73.2 | |
| STAMPBackbone=ResNet-182025.08 | 77.9 | 83.2 | 80.1 | 82.3 | 79.2 | 80.6 | 83.5 | 86.3 | 84.8 | 82.6 | 74.9 | 78.5 | |
| STAMPBackbone=ResNet-182025.08 | 77.9 | 83.2 | 80.1 | 82.3 | 79.2 | 80.6 | 83.5 | 86.3 | 84.8 | 82.6 | 74.9 | 78.5 | |
| SoTTABackbone=ResNet-182025.08 | 77.8 | 51.7 | 61.6 | 79.3 | 72.8 | 75.9 | 79.8 | 77.9 | 78.8 | 79.6 | 72.6 | 75.9 | |
| SoTTABackbone=ResNet-182025.08 | 77.8 | 51.7 | 61.6 | 79.3 | 72.8 | 75.9 | 79.8 | 77.9 | 78.8 | 79.6 | 72.6 | 75.9 | |
| SAR + Hi-VecBackbone=ResNet-182025.08 | 77.7 | 63.8 | 70.7 | 82.5 | 73.3 | 77.7 | 80.2 | 79.9 | 80 | 83 | 69.7 | 75.7 | |
| SAR + Hi-VecBackbone=ResNet-182025.08 | 77.7 | 63.8 | 70.7 | 82.5 | 73.3 | 77.7 | 80.2 | 79.9 | 80 | 83 | 69.7 | 75.7 | |
| RoTTABackbone=ResNet-182025.08 | 77.6 | 74.3 | 75.6 | 78.4 | 76 | 77.2 | 78.8 | 79.5 | 79.1 | 78.6 | 73.3 | 75.8 | |
| RoTTABackbone=ResNet-182025.08 | 77.6 | 74.3 | 75.6 | 78.4 | 76 | 77.2 | 78.8 | 79.5 | 79.1 | 78.6 | 73.3 | 75.8 | |
| TentBackbone=ResNet-182025.08 | 77.4 | 48.7 | 59.7 | 80.8 | 54.9 | 65.1 | 81.2 | 62.3 | 70.4 | 81.1 | 65.6 | 72.4 | |
| TentBackbone=ResNet-182025.08 | 77.4 | 48.7 | 59.7 | 80.8 | 54.9 | 65.1 | 81.2 | 62.3 | 70.4 | 81.1 | 65.6 | 72.4 | |
| CoTTABackbone=ResNet-182025.08 | 77.3 | 62.4 | 67.3 | 81.6 | 78.6 | 80.1 | 82.2 | 84.2 | 83.2 | 81.9 | 75.3 | 78.4 | |
| CoTTABackbone=ResNet-182025.08 | 77.3 | 62.4 | 67.3 | 81.6 | 78.6 | 80.1 | 82.2 | 84.2 | 83.2 | 81.9 | 75.3 | 78.4 | |
| BN StatsBackbone=ResNet-182025.08 | 72.9 | 68.6 | 70.6 | 78.7 | 75.3 | 76.9 | 79.4 | 79.4 | 79.4 | 79 | 72.9 | 75.8 | |
| EATABackbone=ResNet-182025.08 | 72.9 | 68.5 | 70.6 | 78.8 | 75.3 | 76.9 | 79.4 | 79.4 | 79.4 | 78.9 | 73.1 | 75.9 | |
| SARBackbone=ResNet-182025.08 | 72.9 | 68.5 | 70.6 | 78.7 | 75.3 | 76.9 | 79.4 | 79.4 | 79.4 | 79 | 72.9 | 75.8 | |
| BN StatsBackbone=ResNet-182025.08 | 72.9 | 68.6 | 70.6 | 78.7 | 75.3 | 76.9 | 79.4 | 79.4 | 79.4 | 79 | 72.9 | 75.8 | |
| EATABackbone=ResNet-182025.08 | 72.9 | 68.5 | 70.6 | 78.8 | 75.3 | 76.9 | 79.4 | 79.4 | 79.4 | 78.9 | 73.1 | 75.9 | |
| SARBackbone=ResNet-182025.08 | 72.9 | 68.5 | 70.6 | 78.7 | 75.3 | 76.9 | 79.4 | 79.4 | 79.4 | 79 | 72.9 | 75.8 | |
| OWTTTBackbone=ResNet-182025.08 | 62.3 | 64.4 | 58.5 | 66.1 | 75.3 | 69.6 | 63.1 | 78.9 | 68.5 | 56.3 | 58.8 | 56.2 | |
| OWTTTBackbone=ResNet-182025.08 | 62.3 | 64.4 | 58.5 | 66.1 | 75.3 | 69.6 | 63.1 | 78.9 | 68.5 | 56.3 | 58.8 | 56.2 | |
| MRLBackbone=ResNet-182025.08 | 59.7 | 65.7 | 62.6 | 59.7 | 64.4 | 62 | 59.7 | 61.9 | 60.2 | 59.7 | 64.1 | 61.8 | |
| MRLBackbone=ResNet-182025.08 | 59.7 | 65.7 | 62.6 | 59.7 | 64.4 | 62 | 59.7 | 61.9 | 60.2 | 59.7 | 64.1 | 61.8 | |
| SourceBackbone=ResNet-182025.08 | 57.3 | 70.4 | 62.3 | 57.3 | 67.4 | 61.1 | 57.3 | 62.8 | 59.6 | 57.3 | 64.5 | 59.4 | |
| SourceBackbone=ResNet-182025.08 | 57.3 | 70.4 | 62.3 | 57.3 | 67.4 | 61.1 | 57.3 | 62.8 | 59.6 | 57.3 | 64.5 | 59.4 |