Image Classification Calibration on iNaturalist21
7.45ECETS
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TSAlpha=0.1, Nonconformity score=MSP2025.05 | 7.45 | 20.52 | 1.38 | 32.73 | 0.08 | 0.18 | |
| TSNonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 7.45 | 20.52 | 1.38 | 32.73 | 0.08 | 0.18 | |
| TSNonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 7.45 | 20.52 | 1.38 | 32.73 | 0.08 | 0.18 | |
| Ada-TSAlpha=0.1, Nonconformity score=MSP2025.05 | 11.48 | 26.97 | 2.24 | 35.98 | 0.85 | 3.03 | |
| Ada-TSNonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 11.48 | 26.97 | 2.24 | 35.98 | 0.85 | 3.03 | |
| Ada-TS2025.05 | 11.48 | 26.97 | 2.24 | 35.98 | 0.85 | 3.03 | |
| Naive CMCEAlpha=0.1, Nonconformity score=MSP2025.05 | 12.7 | 25.73 | 1.27 | 35.09 | 0.13 | 4.75 | |
| Naive CMCENonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 12.7 | 25.73 | 1.27 | 35.09 | 0.13 | 4.75 | |
| Naive CMCENonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 12.7 | 25.73 | 1.27 | 35.09 | 0.13 | 4.75 | |
| Temp. scalingAlpha=0.1, Nonconformity score=MSP2025.05 | 13.16 | 25.6 | 1.29 | 35.7 | 0.28 | 4.64 | |
| Temp. scalingNonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 13.16 | 25.6 | 1.29 | 35.7 | 0.28 | 4.64 | |
| Temp. scaling2025.05 | 13.16 | 25.6 | 1.29 | 35.7 | 0.28 | 4.64 | |
| Platt ScalingAlpha=0.1, Nonconformity score=MSP2025.05 | 13.97 | 29.66 | 12.51 | 68.02 | 24.59 | 32.98 | |
| Platt ScalingNonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 13.97 | 29.66 | 12.51 | 68.02 | 24.59 | 32.98 | |
| Platt Scaling2025.05 | 13.97 | 29.66 | 12.51 | 68.02 | 24.59 | 32.98 | |
| IsotonicAlpha=0.1, Nonconformity score=MSP2025.05 | 26.43 | 38.47 | 13.71 | 80.19 | 17.54 | 40.01 | |
| IsotonicNonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 26.43 | 38.47 | 13.71 | 80.19 | 17.54 | 40.01 | |
| Isotonic2025.05 | 26.43 | 38.47 | 13.71 | 80.19 | 17.54 | 40.01 | |
| BaseAlpha=0.1, Nonconformity score=MSP2025.05 | 49.73 | 64.52 | 2.04 | 61.49 | 5.55 | 9.61 | |
| BaseNonconformity score=MSP, Alpha=0.1, Transformation=constant2025.05 | 49.73 | 64.52 | 2.04 | 61.49 | 5.55 | 9.61 | |
| Base2025.05 | 49.73 | 64.52 | 2.04 | 61.49 | 5.55 | 9.61 |