Adaptive Conformal Prediction on CIFAR-10C sudden distribution shift
89.99CoverageScaleFreeOGD
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ScaleFreeOGDModel=DenseNet-1212024.11 | 89.99 | 1.46 | 0.0017 | 2.92 | 0.52 | |
| ScaleFreeOGDModel=ResNet-182024.11 | 89.99 | 1.52 | 0.0017 | 2.91 | 0.49 | |
| ScaleFreeOGDModel=GoogLeNet2024.11 | 89.99 | 1.46 | 0.0017 | 2.89 | 0.55 | |
| ScaleFreeOGDModel=ResNet-502024.11 | 89.98 | 1.52 | 0.0017 | 2.89 | 0.54 | |
| FACIModel=ResNet-502024.11 | 89.74 | 1.5 | 0.0014 | 8.11 | 0.55 | |
| FACIModel=GoogLeNet2024.11 | 89.73 | 1.43 | 0.0014 | 8.1 | 0.58 | |
| FACIModel=ResNet-182024.11 | 89.63 | 1.36 | 0.0015 | 8.11 | 0.64 | |
| FACIModel=DenseNet-1212024.11 | 89.57 | 1.3 | 0.0015 | 8.11 | 0.68 | |
| SAOCPModel=ResNet-502024.11 | 89.12 | 1.51 | 0.0022 | 40.25 | 0.53 | |
| SAOCPModel=GoogLeNet2024.11 | 89.09 | 1.44 | 0.0022 | 40.13 | 0.55 | |
| SAOCPModel=ResNet-182024.11 | 88.83 | 1.48 | 0.0022 | 40.16 | 0.51 | |
| SAOCPModel=DenseNet-1212024.11 | 88.77 | 1.41 | 0.0022 | 39.62 | 0.54 | |
| SAMOCPModel=Mixture2024.11 | 88.37 | 1.24 | 0.001 | 33.75 | 0.69 | |
| SAOCP(MM)Model=Mixture2024.11 | 86.8 | 1.45 | 0.0039 | 47.08 | 0.56 |