Conformal Prediction on EMNIST ByClass (test)
1.98Mean Prediction Set SizeDPI bound
Evaluation Results
| Method | Links | |
|---|---|---|
| DPI boundScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 1.98 | |
| ConfTrScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 1.99 | |
| ConfTr_classScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 2.01 | |
| Model-based Fano boundScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 2.01 | |
| CEScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 2.06 | |
| Simple Fano boundScore function=THR, alpha=0.01, Setting=Centralized2024.05 | 2.1 | |
| ConfTrScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 2.36 | |
| ConfTr_classScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 2.38 | |
| Simple Fano boundScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 2.75 | |
| CEScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 3.4 | |
| Model-based Fano boundScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 3.67 | |
| DPI boundScore function=APS, alpha=0.01, Setting=Centralized2024.05 | 4.07 |