Confidence Calibration on cleveland
0.03Calibration ErrorIRP
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| IRPClassifier=Linear SVM, Recalibrator=IRP2026.03 | 0.03 | — | |
| IRPClassifier=MLP, Recalibrator=IRP2026.03 | 0.061 | — | |
| Matrix ScalingClassifier=MLP, Recalibrator=MS2026.03 | 0.099 | — | |
| Dirichlet CalibrationClassifier=MLP, Recalibrator=Dir2026.03 | 0.106 | — | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=152026.03 | 0.119 | — | |
| Temperature ScalingClassifier=MLP, Recalibrator=TS2026.03 | 0.126 | — | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=302026.03 | 0.147 | — | |
| No RecalibrationClassifier=Linear SVM, Recalibrator=—2026.03 | 0.148 | — | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=152026.03 | 0.153 | — | |
| Isotonic RegressionClassifier=MLP, Recalibrator=IR2026.03 | 0.158 | — | |
| Isotonic RegressionClassifier=Linear SVM, Recalibrator=IR2026.03 | 0.158 | — | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=502026.03 | 0.16 | — | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=502026.03 | 0.161 | — | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=302026.03 | 0.168 | — | |
| No RecalibrationClassifier=MLP, Recalibrator=—2026.03 | 0.172 | — | |
| Histogram BinningClassifier=Linear SVM, Recalibrator=Bin2026.03 | 0.183 | — | |
| Matrix ScalingClassifier=Linear SVM, Recalibrator=MS2026.03 | 0.192 | — | |
| Histogram BinningClassifier=MLP, Recalibrator=Bin2026.03 | 0.201 | — | |
| Dirichlet CalibrationClassifier=Linear SVM, Recalibrator=Dir2026.03 | 0.209 | — | |
| Temperature ScalingClassifier=Linear SVM, Recalibrator=TS2026.03 | 0.276 | — | |
| Orthogonal IsotonicClassifier=Linear SVM, Recalibrator=OI2026.03 | 0.3 | — | |
| Orthogonal IsotonicClassifier=MLP, Recalibrator=OI2026.03 | 0.435 | — | |
| BinBase Classifier=MLP2026.03 | — | 0.089 | |
| BinBase Classifier=linear SVM2026.03 | — | 0.076 | |
| BrenierIRBase Classifier=MLP, k=152026.03 | — | 0.072 | |
| BrenierIRBase Classifier=MLP, k=302026.03 | — | 0.083 | |
| BrenierIRBase Classifier=MLP, k=502026.03 | — | 0.087 | |
| BrenierIRBase Classifier=linear SVM, k=152026.03 | — | 0.082 | |
| BrenierIRBase Classifier=linear SVM, k=302026.03 | — | 0.097 | |
| BrenierIRBase Classifier=linear SVM, k=502026.03 | — | 0.093 | |
| DirBase Classifier=MLP2026.03 | — | 0.081 | |
| DirBase Classifier=linear SVM2026.03 | — | 0.083 | |
| IRBase Classifier=MLP2026.03 | — | 0.063 | |
| IRBase Classifier=linear SVM2026.03 | — | 0.089 | |
| IRPBase Classifier=MLP2026.03 | — | 0.035 | |
| IRPBase Classifier=linear SVM2026.03 | — | 0.037 | |
| MSBase Classifier=MLP2026.03 | — | 0.094 | |
| MSBase Classifier=linear SVM2026.03 | — | 0.106 | |
| OIBase Classifier=MLP2026.03 | — | 0.184 | |
| OIBase Classifier=linear SVM2026.03 | — | 0.139 | |
| TSBase Classifier=MLP2026.03 | — | 0.097 | |
| TSBase Classifier=linear SVM2026.03 | — | 0.154 | |
| UncalibratedBase Classifier=MLP2026.03 | — | 0.114 | |
| UncalibratedBase Classifier=linear SVM2026.03 | — | 0.074 |