Uncertainty Quantification on FashionMNIST (using V-ID, V-OOD, MI metrics)
92.5V-IDDE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DEBackbone=ResNet92026.05 | 92.5 | 97.93 | 92.44 | 99.79 | -0.2264 | 0 | 2.672 | |
| DNN-GLMBackbone=ResNet92026.05 | 92.08 | 97.65 | 92.19 | 98.49 | -0.2077 | 0 | 7.254 | |
| SWAGBackbone=ResNet92026.05 | 91.98 | 96.47 | 91.96 | 96.85 | -0.2585 | 0 | 2.511 | |
| LL-GLMBackbone=ResNet92026.05 | 91.88 | 96.51 | 91.79 | 97.54 | -0.2153 | 0 | 1.699 | |
| MCBackbone=ResNet92026.05 | 91.87 | 96.68 | 91.75 | 97.35 | -0.2681 | 0 | 1.901 | |
| LLABackbone=ResNet92026.05 | 90.96 | 96.4 | 90.93 | 97.88 | -0.273 | 0 | 1.952 | |
| SMS-UBUBackbone=ResNet92026.05 | 90.03 | 91.87 | 90.06 | 99.88 | -0.2496 | 0 | 3.316 | |
| LL-GLMBackbone=LeNet2026.05 | 88.05 | 88.71 | 87.53 | 92.47 | -0.3039 | 95.21 | 0.3382 | |
| DNN-GLMBackbone=LeNet2026.05 | 87.91 | 94.6 | 87.17 | 97.66 | -0.3035 | 85.59 | 0.2941 | |
| LLABackbone=LeNet2026.05 | 87.86 | 93.66 | 87.2 | 96.81 | -0.3037 | 14.52 | 0.2551 | |
| DEBackbone=LeNet2026.05 | 87.51 | 94.65 | 86.25 | 97.09 | -0.3035 | 1,740 | 0.2596 | |
| SWAGBackbone=LeNet2026.05 | 86.84 | 83.22 | 87 | 87.35 | -0.3341 | 346.6 | 0.2232 | |
| MCBackbone=LeNet2026.05 | 85.2 | 84.97 | 84.88 | 90.42 | -0.3088 | 12.78 | 0.1071 |