Conformal Prediction on CIFAR 10
0.9Avg Prediction Set Sizesemicp
Evaluation results
| Method | Links | ||
|---|---|---|---|
| semicpScore=THR, Number of labeled data=802025.05 | 0.9 | 0.88 | |
| oracleScore=THR, Number of labeled data=802025.05 | 0.9 | 0.65 | |
| standardScore=THR, Number of labeled data=802025.05 | 0.91 | 2.64 | |
| semicpScore=RAPS, Number of labeled data=802025.05 | 1.38 | 0.98 | |
| oracleScore=RAPS, Number of labeled data=802025.05 | 1.38 | 0.66 | |
| standardScore=RAPS, Number of labeled data=802025.05 | 1.4 | 2.63 | |
| semicpScore=APS, Number of labeled data=802025.05 | 1.42 | 0.96 | |
| oracleScore=APS, Number of labeled data=802025.05 | 1.42 | 0.66 | |
| standardScore=APS, Number of labeled data=802025.05 | 1.44 | 2.62 | |
| MB FanoScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 1.78 | — | |
| DPIScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 1.87 | — | |
| MB FanoScoring Function=APS, Target Alpha=0.012024.05 | 1.89 | — | |
| DPIScoring Function=APS, Target Alpha=0.012024.05 | 1.97 | — | |
| ConfTrclassScoring Function=APS, Target Alpha=0.012024.05 | 2.18 | — | |
| ConfTrclassScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 2.18 | — | |
| FanoScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 2.2 | — | |
| CEScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 2.31 | — | |
| CEScoring Function=APS, Target Alpha=0.012024.05 | 2.34 | — | |
| FanoScoring Function=APS, Target Alpha=0.012024.05 | 2.35 | — | |
| ConfTrScoring Function=APS, Target Alpha=0.012024.05 | 9.99 | — | |
| ConfTrScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 9.99 | — |