Image Classification on CIFAR-10 corrupted (test)
89.4AccDiffusion Calibration
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Diffusion Calibrationσ=0.25, Backbone=ViT-B/16@2242023.10 | 89.4 | — | — | — | |
| Cascaded Randomized Smoothingσ=0.25-0.50, Backbone=ViT-B/16@2242023.10 | 89.1 | — | — | — | |
| Carlini et al.σ=0.25, Backbone=ViT-B/16@2242023.10 | 88.8 | — | — | — | |
| Gaussianσ=0.25, Backbone=ViT-B/16@2242023.10 | 88.3 | — | — | — | |
| Cascaded Randomized Smoothingσ=0.25-1.00, Backbone=ViT-B/16@2242023.10 | 86.9 | — | — | — | |
| Carlini et al.σ=0.50, Backbone=ViT-B/16@2242023.10 | 84.9 | — | — | — | |
| Consistencyσ=0.25, Backbone=ViT-B/16@2242023.10 | 84.7 | — | — | — | |
| Diffusion Calibrationσ=0.50, Backbone=ViT-B/16@2242023.10 | 84.2 | — | — | — | |
| Carlini et al.σ=1.00, Backbone=ViT-B/16@2242023.10 | 83.2 | — | — | — | |
| TEABackbone=ResNet-50, Normalization=GroupNorm2023.11 | 83.05 | — | — | 79.09 | |
| SHOTBackbone=ResNet-50, Normalization=GroupNorm2023.11 | 81.98 | — | — | 86.65 | |
| Gaussianσ=0.50, Backbone=ViT-B/16@2242023.10 | 81.8 | — | — | — | |
| PLBackbone=ResNet-50, Normalization=GroupNorm2023.11 | 79.43 | — | — | 94.76 | |
| Diffusion Calibrationσ=1.00, Backbone=ViT-B/16@2242023.10 | 79.3 | — | — | — | |
| SARBackbone=ResNet-50, Normalization=GroupNorm2023.11 | 78.78 | — | — | 99.65 | |
| SourceBackbone=ResNet-50, Normalization=GroupNorm2023.11 | 78.71 | — | — | 100 | |
| EATABackbone=ResNet-50, Normalization=GroupNorm2023.11 | 78.7 | — | — | 100.02 | |
| ETABackbone=ResNet-50, Normalization=GroupNorm2023.11 | 78.68 | — | — | 100.09 | |
| TENTBackbone=ResNet-50, Normalization=GroupNorm2023.11 | 77.29 | — | — | 102.88 | |
| Consistencyσ=0.50, Backbone=ViT-B/16@2242023.10 | 75 | — | — | — | |
| Gaussianσ=1.00, Backbone=ViT-B/16@2242023.10 | 72.4 | — | — | — | |
| Consistencyσ=1.00, Backbone=ViT-B/16@2242023.10 | 61.3 | — | — | — | |
| Cross EntropyTraining Regime=Full2022.05 | 43 | 84 | 4.43 | — | |
| FocalTraining Regime=Full2022.05 | 42 | 83 | 3.99 | — | |
| HybridTraining Regime=Full2022.05 | 40 | 81 | 5.75 | — | |
| HybridTraining Regime=Early Stopping (acc)2022.05 | 37 | 86 | 5.3 | — | |
| Cross EntropyTraining Regime=Early Stopping (acc)2022.05 | 36 | 81 | 5.05 | — | |
| ConformalTraining Regime=Full2022.05 | 35 | 90 | 5.95 | — | |
| ConformalTraining Regime=Early Stopping (acc)2022.05 | 35 | 87 | 6.09 | — | |
| FocalTraining Regime=Early Stopping (acc)2022.05 | 34 | 77 | 4.25 | — |