Conformal Prediction on F-MNIST
1.7Average Prediction Set SizeSimple Fano bound
Evaluation Results
| Method | Links | |
|---|---|---|
| Simple Fano boundScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 1.7 | |
| ConfTrScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 1.73 | |
| DPI boundScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 1.73 | |
| ConfTrclassScoring Function=APS, Target Alpha=0.012024.05 | 1.79 | |
| ConfTrclassScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 1.79 | |
| ConfTr_classScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 1.79 | |
| FanoScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 1.8 | |
| Model-based Fano boundScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 1.8 | |
| ConfTrScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 1.84 | |
| FanoScoring Function=APS, Target Alpha=0.012024.05 | 1.87 | |
| Simple Fano boundScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 1.87 | |
| ConfTrScoring Function=APS, Target Alpha=0.012024.05 | 1.89 | |
| ConfTrScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 1.89 | |
| DPIScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 1.95 | |
| MB FanoScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 2.07 | |
| DPIScoring Function=APS, Target Alpha=0.012024.05 | 2.08 | |
| DPI boundScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 2.08 | |
| MB FanoScoring Function=APS, Target Alpha=0.012024.05 | 2.25 | |
| Model-based Fano boundScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 2.25 | |
| CEScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 2.39 | |
| CEScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.05 | 2.4 | |
| CEScoring Function=APS, Target Alpha=0.012024.05 | 2.41 | |
| CEScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 2.41 | |
| ConfTr_classScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 5.11 |