Online Conformal Prediction on CIFAR-100C gradual distribution shift (test)
89.97CoverageScaleFreeOGD
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ScaleFreeOGDBackbone=DenseNet-1212024.11 | 89.97 | 6.04 | 1,550 | 3.02 | 0.26 | |
| ScaleFreeOGDBackbone=ResNet-502024.11 | 89.97 | 6.72 | 1,580 | 3.12 | 0.25 | |
| ScaleFreeOGDBackbone=ResNet-182024.11 | 89.96 | 7.29 | 1,550 | 3.05 | 0.23 | |
| ScaleFreeOGDBackbone=GoogLeNet2024.11 | 89.96 | 6.71 | 1,520 | 3.04 | 0.24 | |
| FACIBackbone=ResNet-502024.11 | 89.67 | 6.5 | 1,240 | 8.45 | 0.26 | |
| FACIBackbone=DenseNet-1212024.11 | 89.64 | 5.77 | 1,180 | 8.22 | 0.28 | |
| FACIBackbone=GoogLeNet2024.11 | 89.63 | 6.33 | 1,100 | 8.3 | 0.27 | |
| FACIBackbone=ResNet-182024.11 | 89.56 | 6.82 | 1,170 | 8.39 | 0.25 | |
| SAOCPBackbone=DenseNet-1212024.11 | 88.9 | 5.8 | 2,040 | 40.74 | 0.27 | |
| SAOCPBackbone=ResNet-502024.11 | 88.79 | 6.48 | 2,080 | 41.35 | 0.25 | |
| SAOCPBackbone=ResNet-182024.11 | 88.76 | 6.9 | 2,060 | 41.23 | 0.24 | |
| SAOCPBackbone=GoogLeNet2024.11 | 88.68 | 6.38 | 2,070 | 41.13 | 0.26 | |
| SAMOCPBackbone=Mixture2024.11 | 88.16 | 5.43 | 920 | 34.87 | 0.29 | |
| SAOCP(MM)Backbone=Mixture2024.11 | 85.89 | 6.61 | 4,420 | 47.8 | 0.27 |