List your company
ResearchFormerly WizWand

Conformal Prediction on F-MNIST

1.7Average Prediction Set SizeSimple Fano bound
1.56362.48433.4054.3257May 3, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Simple Fano boundScore function=THR, alpha=0.01, Setting=Centralized2024.051.7
ConfTrScore function=THR, alpha=0.01, Setting=Centralized2024.051.73
DPI boundScore function=THR, alpha=0.01, Setting=Centralized2024.051.73
ConfTrclassScoring Function=APS, Target Alpha=0.012024.051.79
ConfTrclassScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.051.79
ConfTr_classScore function=APS, alpha=0.01, Setting=Centralized2024.051.79
FanoScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.051.8
Model-based Fano boundScore function=THR, alpha=0.01, Setting=Centralized2024.051.8
ConfTrScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.051.84
FanoScoring Function=APS, Target Alpha=0.012024.051.87
Simple Fano boundScore function=APS, alpha=0.01, Setting=Centralized2024.051.87
ConfTrScoring Function=APS, Target Alpha=0.012024.051.89
ConfTrScore function=APS, alpha=0.01, Setting=Centralized2024.051.89
DPIScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.051.95
MB FanoScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.052.07
DPIScoring Function=APS, Target Alpha=0.012024.052.08
DPI boundScore function=APS, alpha=0.01, Setting=Centralized2024.052.08
MB FanoScoring Function=APS, Target Alpha=0.012024.052.25
Model-based Fano boundScore function=APS, alpha=0.01, Setting=Centralized2024.052.25
CEScore function=THR, alpha=0.01, Setting=Centralized2024.052.39
CEScoring Function=RAPS, Target Alpha=0.01, k_reg=1, lambda_reg=0.012024.052.4
CEScoring Function=APS, Target Alpha=0.012024.052.41
CEScore function=APS, alpha=0.01, Setting=Centralized2024.052.41
ConfTr_classScore function=THR, alpha=0.01, Setting=Centralized2024.055.11