Conformal Calibration on UAI ID 22
2.1ECEStd CP (ICG-I)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Std CP (ICG-I)Nominal alpha=0.05, Inference time (s)=0.142026.06 | 2.1 | 94.8 | 1.45 | |
| WCP (ICG-I)Nominal alpha=0.05, Effective sample size (neff)=985, Inference time (s)=0.152026.06 | 2.1 | 95.2 | 1.48 | |
| Std CP (ICG-I)Nominal alpha=0.20, Inference time (s)=0.142026.06 | 2.1 | 79.5 | 1.15 | |
| WCP (ICG-I)Nominal alpha=0.20, Effective sample size (neff)=985, Inference time (s)=0.152026.06 | 2.1 | 80.2 | 1.18 | |
| Std CP (Deep Ensemble)Nominal alpha=0.05, Inference time (s)=0.852026.06 | 8.5 | 88.5 | 1.85 | |
| Std CP (Deep Ensemble)Nominal alpha=0.20, Inference time (s)=0.852026.06 | 8.5 | 78.5 | 1.45 | |
| Std CP (LBP)Nominal alpha=0.05, Inference time (s)=3.452026.06 | 12.4 | 84.2 | 1.62 | |
| Std CP (LBP)Nominal alpha=0.20, Inference time (s)=3.452026.06 | 12.4 | 72.5 | 1.25 |