Backward Conformal Prediction on CIFAR-10
1.45Miscoverage (%)BCP
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BCPSize constraint rule (T)=3, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 1.45 | 1.16 | 13,400 | 5.64 | |
| ST-BCPSize constraint rule (T)=3, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 1.45 | 0.66 | 4,300 | 0.52 | |
| BCPSize constraint rule (T)=2, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 2.26 | 1.28 | 16,300 | 5.38 | |
| ST-BCPSize constraint rule (T)=2, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 2.26 | 0.89 | 7,900 | 0.72 | |
| BCPSize constraint rule (T)=Average, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 4.07 | 1.43 | 20,700 | 4.21 | |
| ST-BCPSize constraint rule (T)=Average, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 4.07 | 1.06 | 11,900 | 1.12 | |
| BCPSize constraint rule (T)=T(X), Backbone=ResNet50, Calibration set size (n)=2002026.02 | 4.27 | 1.43 | 20,400 | 4.04 | |
| ST-BCPSize constraint rule (T)=T(X), Backbone=ResNet50, Calibration set size (n)=2002026.02 | 4.27 | 1.13 | 12,800 | 1.17 | |
| BCPSize constraint rule (T)=T(D, X), Backbone=ResNet50, Calibration set size (n)=2002026.02 | 5.23 | 1.55 | 24,100 | 3.57 | |
| ST-BCPSize constraint rule (T)=T(D, X), Backbone=ResNet50, Calibration set size (n)=2002026.02 | 5.23 | 1.23 | 15,400 | 1.27 | |
| BCPSize constraint rule (T)=1, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 7.13 | 1.71 | 29,400 | 2.4 | |
| ST-BCPSize constraint rule (T)=1, Backbone=ResNet50, Calibration set size (n)=2002026.02 | 7.13 | 1.38 | 19,100 | 1.9 |