Confidence Calibration on car
1.1Calibration ErrorDirichlet Calibration
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Dirichlet CalibrationClassifier=MLP, Recalibrator=Dir2026.03 | 1.1 | — | |
| Isotonic RegressionClassifier=MLP, Recalibrator=IR2026.03 | 1.1 | — | |
| Matrix ScalingClassifier=MLP, Recalibrator=MS2026.03 | 1.1 | — | |
| IRPClassifier=MLP, Recalibrator=IRP2026.03 | 1.3 | — | |
| Temperature ScalingClassifier=MLP, Recalibrator=TS2026.03 | 1.5 | — | |
| Histogram BinningClassifier=MLP, Recalibrator=Bin2026.03 | 1.6 | — | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=502026.03 | 1.6 | — | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=302026.03 | 1.7 | — | |
| BrenierIRClassifier=MLP, Recalibrator=BrenierIR, k=152026.03 | 1.9 | — | |
| No RecalibrationClassifier=MLP, Recalibrator=—2026.03 | 2.4 | — | |
| No RecalibrationClassifier=Linear SVM, Recalibrator=—2026.03 | 2.6 | — | |
| DirBase Model=MLP2026.03 | 3 | — | |
| IRPBase Model=MLP2026.03 | 3.1 | — | |
| IRBase Model=MLP2026.03 | 3.4 | — | |
| TSBase Model=MLP2026.03 | 3.6 | — | |
| MSBase Model=MLP2026.03 | 3.7 | — | |
| BrenierIRBase Model=MLP, k=302026.03 | 4 | — | |
| BrenierIRBase Model=MLP, k=502026.03 | 4.2 | — | |
| BrenierIRBase Model=MLP, k=152026.03 | 4.5 | — | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=152026.03 | 4.6 | — | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=502026.03 | 4.9 | — | |
| BinBase Model=MLP2026.03 | 5 | — | |
| Matrix ScalingClassifier=Linear SVM, Recalibrator=MS2026.03 | 5.9 | — | |
| BrenierIRClassifier=Linear SVM, Recalibrator=BrenierIR, k=302026.03 | 6.2 | — | |
| Orthogonal IsotonicClassifier=MLP, Recalibrator=OI2026.03 | 6.3 | — | |
| UncalibratedBase Model=MLP2026.03 | 6.3 | — | |
| Isotonic RegressionClassifier=Linear SVM, Recalibrator=IR2026.03 | 8.6 | — | |
| Dirichlet CalibrationClassifier=Linear SVM, Recalibrator=Dir2026.03 | 8.8 | — | |
| Orthogonal IsotonicClassifier=Linear SVM, Recalibrator=OI2026.03 | 9.2 | — | |
| Histogram BinningClassifier=Linear SVM, Recalibrator=Bin2026.03 | 10.1 | — | |
| UncalibratedBase Model=Linear SVM2026.03 | 10.6 | — | |
| BrenierIRBase Model=Linear SVM, k=152026.03 | 12.1 | — | |
| OIBase Model=MLP2026.03 | 13.2 | — | |
| BrenierIRBase Model=Linear SVM, k=502026.03 | 17.3 | — | |
| BrenierIRBase Model=Linear SVM, k=302026.03 | 17.9 | — | |
| Temperature ScalingClassifier=Linear SVM, Recalibrator=TS2026.03 | 21.8 | — | |
| IRBase Model=Linear SVM2026.03 | 26.6 | — | |
| IRPClassifier=Linear SVM, Recalibrator=IRP2026.03 | 27.7 | — | |
| BinBase Model=Linear SVM2026.03 | 28.4 | — | |
| DirBase Model=Linear SVM2026.03 | 33.2 | — | |
| MSBase Model=Linear SVM2026.03 | 41.3 | — | |
| IRPBase Model=Linear SVM2026.03 | 55.8 | — | |
| TSBase Model=Linear SVM2026.03 | 58.9 | — | |
| OIBase Model=Linear SVM2026.03 | 71.7 | — | |
| BinBase Classifier=MLP2026.03 | — | 1.1 | |
| BinBase Classifier=linear SVM2026.03 | — | 6.5 | |
| BrenierIRBase Classifier=MLP, k=152026.03 | — | 1.1 | |
| BrenierIRBase Classifier=MLP, k=302026.03 | — | 1 | |
| BrenierIRBase Classifier=MLP, k=502026.03 | — | 0.9 | |
| BrenierIRBase Classifier=linear SVM, k=152026.03 | — | 2.8 | |
| BrenierIRBase Classifier=linear SVM, k=302026.03 | — | 4.1 | |
| BrenierIRBase Classifier=linear SVM, k=502026.03 | — | 3.5 | |
| DirBase Classifier=MLP2026.03 | — | 0.7 | |
| DirBase Classifier=linear SVM2026.03 | — | 5.4 | |
| IRBase Classifier=MLP2026.03 | — | 0.8 | |
| IRBase Classifier=linear SVM2026.03 | — | 5.2 | |
| IRPBase Classifier=MLP2026.03 | — | 0.7 | |
| IRPBase Classifier=linear SVM2026.03 | — | 13.9 | |
| MSBase Classifier=MLP2026.03 | — | 0.8 | |
| MSBase Classifier=linear SVM2026.03 | — | 5.2 | |
| OIBase Classifier=MLP2026.03 | — | 2.8 | |
| OIBase Classifier=linear SVM2026.03 | — | 17.7 | |
| TSBase Classifier=MLP2026.03 | — | 0.8 | |
| TSBase Classifier=linear SVM2026.03 | — | 13.3 | |
| UncalibratedBase Classifier=MLP2026.03 | — | 1.5 | |
| UncalibratedBase Classifier=linear SVM2026.03 | — | 2.4 |