Classification Calibration on ImageNet-C severity level 5 (test)
0.044ECE (Mean)Δ-UQ
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Δ-UQBackbone=ResNet-50, Severity Level=52022.07 | 0.044 | 0.022 | 0.038 | 0.063 | 4.014 | 4.617 | 4.352 | 4.987 | 0.868 | 0.925 | 0.887 | 0.949 | |
| SVI-AvUCBackbone=ResNet-50, Severity Level=52022.07 | 0.054 | 0.032 | 0.045 | 0.07 | 4.164 | 4.823 | 4.707 | 5.778 | 0.883 | 0.935 | 0.9 | 0.985 | |
| DEnsBackbone=ResNet-50, Severity Level=52022.07 | 0.088 | 0.05 | 0.09 | 0.126 | 4.035 | 4.624 | 4.604 | 5.893 | 0.877 | 0.922 | 0.888 | 0.989 | |
| SVIBackbone=ResNet-50, Severity Level=52022.07 | 0.119 | 0.072 | 0.114 | 0.172 | 4.322 | 4.853 | 4.865 | 6.034 | 0.906 | 0.943 | 0.922 | 1.013 | |
| MCDBackbone=ResNet-50, Severity Level=52022.07 | 0.153 | 0.078 | 0.134 | 0.219 | 4.699 | 5.093 | 5.553 | 6.522 | 0.933 | 0.967 | 0.961 | 1.025 | |
| Temp ScalingBackbone=ResNet-50, Severity Level=52022.07 | 0.16 | 0.096 | 0.139 | 0.236 | 4.53 | 4.993 | 5.091 | 6.165 | 0.926 | 0.97 | 0.945 | 1.027 | |
| LL-DropoutBackbone=ResNet-50, Severity Level=52022.07 | 0.161 | 0.093 | 0.145 | 0.236 | 4.563 | 5.034 | 5.201 | 6.342 | 0.923 | 0.969 | 0.947 | 1.025 | |
| VanillaBackbone=ResNet-50, Severity Level=52022.07 | 0.194 | 0.124 | 0.174 | 0.274 | 4.635 | 5.115 | 5.234 | 6.292 | 0.941 | 0.987 | 0.964 | 1.052 | |
| CALS-ALMArchitecture=ResNet-50, Corruption Type=Gaussian noise, Severity Level=52022.11 | 22.52 | — | — | — | — | — | — | — | — | — | — | — | |
| FLArchitecture=ResNet-50, Corruption Type=Gaussian noise, Severity Level=52022.11 | 23.73 | — | — | — | — | — | — | — | — | — | — | — | |
| LSArchitecture=ResNet-50, Corruption Type=Gaussian noise, Severity Level=52022.11 | 24 | — | — | — | — | — | — | — | — | — | — | — | |
| CEArchitecture=ResNet-50, Corruption Type=Gaussian noise, Severity Level=52022.11 | 26.25 | — | — | — | — | — | — | — | — | — | — | — | |
| MbLSArchitecture=ResNet-50, Corruption Type=Gaussian noise, Severity Level=52022.11 | 26.55 | — | — | — | — | — | — | — | — | — | — | — |