Confidence Calibration on dermatology
0.013Confidence Calibration ErrorIR
Evaluation results
| Method | Links | |
|---|---|---|
| IRBase Classifier=linear SVM2026.03 | 0.013 | |
| BrenierIRBase Classifier=MLP, k=152026.03 | 0.019 | |
| BrenierIRBase Classifier=linear SVM, k=302026.03 | 0.02 | |
| BrenierIRBase Classifier=linear SVM, k=502026.03 | 0.02 | |
| BrenierIRBase Classifier=linear SVM, k=152026.03 | 0.021 | |
| IRBase Classifier=MLP2026.03 | 0.023 | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=152026.03 | 0.024 | |
| DirBase Classifier=MLP2026.03 | 0.024 | |
| MSBase Classifier=linear SVM2026.03 | 0.024 | |
| BrenierIRBase Classifier=MLP, k=302026.03 | 0.026 | |
| MSBase Classifier=MLP2026.03 | 0.027 | |
| TSBase Classifier=MLP2026.03 | 0.027 | |
| BrenierIRBase Classifier=MLP, k=502026.03 | 0.027 | |
| UncalibratedBase Classifier=MLP2026.03 | 0.028 | |
| IRPBase Classifier=MLP2026.03 | 0.029 | |
| DirBase Classifier=linear SVM2026.03 | 0.029 | |
| BinBase Classifier=MLP2026.03 | 0.03 | |
| Isotonic RegressionClassifier=Linear SVM, Recalibrator=IR2026.03 | 0.033 | |
| UncalibratedBase Classifier=linear SVM2026.03 | 0.04 | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=502026.03 | 0.041 | |
| BinBase Classifier=linear SVM2026.03 | 0.041 | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=302026.03 | 0.043 | |
| Histogram BinningClassifier=MLP, Recalibrator=Bin2026.03 | 0.05 | |
| IRPBase Classifier=linear SVM2026.03 | 0.051 | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=152026.03 | 0.054 | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=502026.03 | 0.057 | |
| No RecalibrationClassifier=MLP, Recalibrator=—2026.03 | 0.058 | |
| Isotonic RegressionClassifier=MLP, Recalibrator=IR2026.03 | 0.058 | |
| Temperature ScalingClassifier=MLP, Recalibrator=TS2026.03 | 0.058 | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=302026.03 | 0.058 | |
| Temperature ScalingClassifier=Linear SVM, Recalibrator=TS2026.03 | 0.061 | |
| OIBase Classifier=linear SVM2026.03 | 0.063 | |
| Matrix ScalingClassifier=Linear SVM, Recalibrator=MS2026.03 | 0.064 | |
| Dirichlet CalibrationClassifier=MLP, Recalibrator=Dir2026.03 | 0.066 | |
| Matrix ScalingClassifier=MLP, Recalibrator=MS2026.03 | 0.067 | |
| OIBase Classifier=MLP2026.03 | 0.069 | |
| IRBase Model=Linear SVM2026.03 | 0.082 | |
| IRPClassifier=MLP, Recalibrator=IRP2026.03 | 0.083 | |
| Histogram BinningClassifier=Linear SVM, Recalibrator=Bin2026.03 | 0.083 | |
| No RecalibrationClassifier=Linear SVM, Recalibrator=—2026.03 | 0.087 | |
| TSBase Classifier=linear SVM2026.03 | 0.098 | |
| IRPClassifier=Linear SVM, Recalibrator=IRP2026.03 | 0.1 | |
| Orthogonal IsotonicClassifier=Linear SVM, Recalibrator=OI2026.03 | 0.102 | |
| BrenierIRBase Model=MLP, k=152026.03 | 0.122 | |
| BrenierIRBase Model=Linear SVM, k=502026.03 | 0.126 | |
| BrenierIRBase Model=Linear SVM, k=302026.03 | 0.128 | |
| IRBase Model=MLP2026.03 | 0.139 | |
| BrenierIRBase Model=Linear SVM, k=152026.03 | 0.139 | |
| MSBase Model=Linear SVM2026.03 | 0.144 | |
| DirBase Model=MLP2026.03 | 0.153 | |
| BrenierIRBase Model=MLP, k=302026.03 | 0.159 | |
| TSBase Model=MLP2026.03 | 0.163 | |
| MSBase Model=MLP2026.03 | 0.167 | |
| BrenierIRBase Model=MLP, k=502026.03 | 0.17 | |
| UncalibratedBase Model=MLP2026.03 | 0.178 | |
| BinBase Model=MLP2026.03 | 0.187 | |
| DirBase Model=Linear SVM2026.03 | 0.192 | |
| IRPBase Model=MLP2026.03 | 0.204 | |
| Dirichlet CalibrationClassifier=Linear SVM, Recalibrator=Dir2026.03 | 0.224 | |
| UncalibratedBase Model=Linear SVM2026.03 | 0.253 | |
| BinBase Model=Linear SVM2026.03 | 0.289 | |
| IRPBase Model=Linear SVM2026.03 | 0.314 | |
| Orthogonal IsotonicClassifier=MLP, Recalibrator=OI2026.03 | 0.418 | |
| OIBase Model=Linear SVM2026.03 | 0.436 | |
| TSBase Model=Linear SVM2026.03 | 0.635 | |
| OIBase Model=MLP2026.03 | 0.798 |