Classification Calibration on MEPS (test)
0.81Oracle ECEPlatt
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PlattBase Predictor=NaiveBayes, (Base, Post) setting=(UU,UU)2026.05 | 0.81 | 36.93 | 3.51 | 0.81 | 38.47 | 3.77 | 82.62 | |
| Platt(Base,Post)=(UU,UU), Base Predictor=RandomForest2026.05 | 1.54 | 23.11 | 1.89 | 1.56 | 24.89 | 2.13 | 82.62 | |
| WLMC(Base,Post)=(PN,PN), Base Predictor=RandomForest2026.05 | 1.74 | 9.05 | 0.45 | 1.74 | 9.06 | 0.45 | 86.32 | |
| ERM(Base,Post)=(PN,PN), Base Predictor=RandomForest2026.05 | 1.76 | 8.94 | 0.41 | 1.76 | 8.94 | 0.41 | 86.32 | |
| Platt(Base,Post)=(PN,Pconf), Base Predictor=RandomForest2026.05 | 1.76 | 9.43 | 0.37 | 0.8 | 2.29 | 0.21 | 86.33 | |
| Temp(Base,Post)=(PN,Pconf), Base Predictor=RandomForest2026.05 | 1.77 | 9.19 | 0.39 | 0.82 | 2.46 | 0.21 | 86.32 | |
| WLMC(Base,Post)=(PN,UU), Base Predictor=RandomForest2026.05 | 1.98 | 9.22 | 0.51 | 2.97 | 15.99 | 0.7 | 86.2 | |
| WLMC(Base,Post)=(PN,Pconf), Base Predictor=RandomForest2026.05 | 2.03 | 9.01 | 0.62 | 1.8 | 6.58 | 1.28 | 86.32 | |
| ERM(Base, Post)=(PN, PN), Base Predictor=LogisticRegression2026.05 | 2.04 | 9.9 | 0.54 | 2.04 | 9.9 | 0.54 | 86.29 | |
| WLMC(Base, Post)=(PN, UU), Base Predictor=LogisticRegression2026.05 | 2.06 | 10.16 | 0.55 | 3.15 | 19.65 | 0.72 | 86.29 | |
| Platt(Base,Post)=(UU,UU), Base Predictor=DecisionTree2026.05 | 2.08 | 28.05 | 2.51 | 2.3 | 30.12 | 2.62 | 82.9 | |
| WLMC(Base, Post)=(PN, PN), Base Predictor=LogisticRegression2026.05 | 2.09 | 9.9 | 0.6 | 2.09 | 9.9 | 0.6 | 86.29 | |
| Temp(Base,Post)=(PN,UU), Base Predictor=RandomForest2026.05 | 2.13 | 9.27 | 0.54 | 3.09 | 16.85 | 0.73 | 86.32 | |
| WLMC(Base,Post)=(PN,PU), Base Predictor=RandomForest2026.05 | 2.14 | 10.18 | 0.59 | 4.01 | 21.99 | 1.06 | 86.26 | |
| WLMC(Base, Post)=(PN, PU), Base Predictor=LogisticRegression2026.05 | 2.15 | 9.72 | 0.69 | 4.48 | 24.15 | 0.93 | 86.17 | |
| WLMCDistribution (Base,Post)=(PN,PU), Base Predictor=MLP2026.05 | 2.17 | 10.03 | 0.8 | 4.33 | 20.15 | 1.01 | 86.39 | |
| Temp(Base,Post)=(PN,PU), Base Predictor=RandomForest2026.05 | 2.18 | 9.16 | 0.54 | 4.47 | 19.83 | 0.88 | 86.32 | |
| Temp(Base, Post)=(PN, UU), Base Predictor=LogisticRegression2026.05 | 2.22 | 9.89 | 0.69 | 3.27 | 18.64 | 0.82 | 86.29 | |
| WLMCDistribution (Base,Post)=(PU,PU), Base Predictor=MLP2026.05 | 2.29 | 10.29 | 0.88 | 3.88 | 20.85 | 0.97 | 85.32 | |
| PlattDistribution (Base,Post)=(PU,PU), Base Predictor=MLP2026.05 | 2.3 | 11.09 | 0.76 | 3.74 | 19.54 | 0.95 | 85.44 | |
| Temp(Base, Post)=(PN, PU), Base Predictor=LogisticRegression2026.05 | 2.32 | 9.74 | 0.74 | 4.71 | 23.67 | 0.97 | 86.29 | |
| PlattBase Predictor=NaiveBayes, (Base, Post) setting=(PU,PU)2026.05 | 2.32 | 27.7 | 2.52 | 2.33 | 26.2 | 2.48 | 82.62 | |
| TempDistribution (Base,Post)=(PN,PU), Base Predictor=MLP2026.05 | 2.34 | 10.16 | 0.63 | 4.47 | 21.05 | 0.92 | 86.43 | |
| Platt(Base,Post)=(PN,UU), Base Predictor=RandomForest2026.05 | 2.35 | 10.54 | 0.46 | 3.21 | 16.84 | 0.66 | 85.9 | |
| TempDistribution (Base,Post)=(PN,UU), Base Predictor=MLP2026.05 | 2.38 | 10.27 | 0.64 | 3.16 | 15.2 | 0.77 | 86.43 | |
| WLMC(Base, Post)=(UU, UU), Base Predictor=LogisticRegression2026.05 | 2.4 | 12.04 | 0.72 | 2.95 | 16.09 | 0.76 | 84.36 | |
| TempDistribution (Base,Post)=(PU,PU), Base Predictor=MLP2026.05 | 2.41 | 10.67 | 0.79 | 4.04 | 20.97 | 0.99 | 85.4 | |
| ERMDistribution (Base,Post)=(PN,PN), Base Predictor=MLP2026.05 | 2.44 | 10.28 | 0.7 | 2.43 | 10.28 | 0.7 | 86.43 | |
| WLMCDistribution (Base,Post)=(PN,PN), Base Predictor=MLP2026.05 | 2.46 | 10.19 | 0.75 | 2.46 | 10.19 | 0.75 | 86.43 | |
| WLMCDistribution (Base,Post)=(PN,UU), Base Predictor=MLP2026.05 | 2.46 | 10.18 | 0.97 | 3.31 | 15.46 | 0.97 | 86.44 | |
| ERMDistribution (Base,Post)=(PU,PU), Base Predictor=MLP2026.05 | 2.46 | 10.41 | 0.76 | 4.05 | 21.3 | 1.08 | 85.4 | |
| Platt(Base, Post)=(PN, UU), Base Predictor=LogisticRegression2026.05 | 2.48 | 11.4 | 0.73 | 3.48 | 19.92 | 0.84 | 86.1 | |
| PlattDistribution (Base,Post)=(PN,PU), Base Predictor=MLP2026.05 | 2.5 | 10.37 | 0.63 | 4.4 | 19.16 | 0.89 | 86.36 | |
| PlattDistribution (Base,Post)=(UU,UU), Base Predictor=MLP2026.05 | 2.51 | 25.7 | 1.73 | 2.47 | 27.88 | 1.94 | 82.64 | |
| WLMCDistribution (Base,Post)=(PN,Pconf), Base Predictor=MLP2026.05 | 2.52 | 9.98 | 1.01 | 4.19 | 10.94 | 1.95 | 86.43 | |
| WLMC(Base, Post)=(PN, Pconf), Base Predictor=LogisticRegression2026.05 | 2.56 | 9.93 | 0.98 | 4.14 | 11.67 | 1.87 | 86.29 | |
| PlattDistribution (Base,Post)=(PN,UU), Base Predictor=MLP2026.05 | 2.63 | 10.64 | 0.65 | 3.41 | 16.75 | 0.81 | 86.45 | |
| Platt(Base,Post)=(PN,PN), Base Predictor=RandomForest2026.05 | 2.63 | 10.62 | 0.83 | 2.63 | 10.62 | 0.83 | 86.27 | |
| Platt(Base,Post)=(PN,PU), Base Predictor=RandomForest2026.05 | 2.68 | 11.55 | 0.52 | 4.34 | 21.86 | 0.86 | 85.98 | |
| Platt(Base, Post)=(PN, PU), Base Predictor=LogisticRegression2026.05 | 2.7 | 11.61 | 0.77 | 4.89 | 22.15 | 0.98 | 86.12 | |
| PlattBase Predictor=NaiveBayes, (Base, Post) setting=(PN,PN)2026.05 | 2.72 | 22.97 | 2.05 | 2.72 | 22.97 | 2.05 | 82.62 | |
| Platt(Base, Post)=(UU, UU), Base Predictor=LogisticRegression2026.05 | 2.73 | 10.39 | 0.93 | 3.3 | 16.68 | 0.97 | 84.57 | |
| Temp(Base, Post)=(UU, UU), Base Predictor=LogisticRegression2026.05 | 2.85 | 11.71 | 0.93 | 3.4 | 15.9 | 0.98 | 84.48 | |
| Platt(Base, Post)=(PU, PU), Base Predictor=LogisticRegression2026.05 | 2.86 | 11.42 | 0.9 | 3.08 | 16.69 | 0.99 | 84.57 | |
| Platt(Base,Post)=(PN,PN), Base Predictor=DecisionTree2026.05 | 2.95 | 23.28 | 2.07 | 2.95 | 23.28 | 2.07 | 83.6 | |
| PlattBase Predictor=NaiveBayes, (Base, Post) setting=(Pconf,Pconf)2026.05 | 3.01 | 14.12 | 1.03 | 2.4 | 6.83 | 1.12 | 83.11 | |
| WLMCBase Predictor=NaiveBayes, (Base, Post) setting=(UU,UU)2026.05 | 3.03 | 16.25 | 1.17 | 3.59 | 20.07 | 1.38 | 82.78 | |
| WLMC(Base, Post)=(PU, PU), Base Predictor=LogisticRegression2026.05 | 3.14 | 12.82 | 0.81 | 3.34 | 16.18 | 1.02 | 84.34 | |
| Temp(Base, Post)=(PN, Pconf), Base Predictor=LogisticRegression2026.05 | 3.24 | 11.29 | 0.62 | 3.36 | 11.64 | 1.11 | 86.29 | |
| TempDistribution (Base,Post)=(PN,Pconf), Base Predictor=MLP2026.05 | 3.25 | 10.72 | 0.71 | 3.32 | 10 | 1.05 | 86.43 | |
| ERM(Base, Post)=(UU, UU), Base Predictor=LogisticRegression2026.05 | 3.25 | 11.42 | 1.1 | 3.71 | 15.58 | 1.1 | 84.48 | |
| Temp(Base, Post)=(PU, PU), Base Predictor=LogisticRegression2026.05 | 3.31 | 13.34 | 0.92 | 3.51 | 16.21 | 1 | 84.27 | |
| ERM(Base, Post)=(PU, PU), Base Predictor=LogisticRegression2026.05 | 3.61 | 12.89 | 1.19 | 3.64 | 16.5 | 1.06 | 84.27 | |
| TempDistribution (Base,Post)=(PN,PN), Base Predictor=MLP2026.05 | 3.69 | 10.02 | 1.29 | 3.69 | 10.02 | 1.29 | 86.43 | |
| Platt(Base,Post)=(PU,PU), Base Predictor=RandomForest2026.05 | 3.7 | 26.55 | 2.14 | 4.08 | 25.43 | 2.15 | 83.65 | |
| PlattDistribution (Base,Post)=(PN,Pconf), Base Predictor=MLP2026.05 | 3.85 | 12.85 | 0.79 | 3.24 | 8.83 | 1.1 | 86.38 | |
| PlattBase Predictor=NaiveBayes, (Base, Post) setting=(PN,PU)2026.05 | 3.9 | 20.8 | 1.82 | 3.59 | 19.26 | 1.74 | 82.62 | |
| Platt(Base,Post)=(Pconf,Pconf), Base Predictor=DecisionTree2026.05 | 3.96 | 16.22 | 0.8 | 4.29 | 14.61 | 1.56 | 85.22 | |
| WLMC(Base,Post)=(UU,UU), Base Predictor=DecisionTree2026.05 | 4.03 | 20.55 | 0.9 | 4.45 | 25.18 | 1 | 84.03 | |
| Platt(Base,Post)=(Pconf,Pconf), Base Predictor=RandomForest2026.05 | 4.08 | 15.41 | 0.72 | 3.65 | 12.34 | 1.49 | 85.27 | |
| PlattBase Predictor=NaiveBayes, (Base, Post) setting=(PN,Pconf)2026.05 | 4.09 | 20.23 | 1.77 | 2.57 | 11.38 | 1.16 | 82.62 | |
| PlattBase Predictor=SVM, (Base, Post)=(PN,PN)2026.05 | 4.15 | 25.5 | 2.49 | 4.15 | 25.5 | 2.49 | 84.66 | |
| PlattBase Predictor=SVM, (Base, Post)=(PN,UU)2026.05 | 4.22 | 25.13 | 2.5 | 4.41 | 27.7 | 2.61 | 85.37 | |
| PlattBase Predictor=NaiveBayes, (Base, Post) setting=(PN,UU)2026.05 | 4.23 | 21.24 | 1.85 | 4.1 | 23.52 | 2.08 | 82.62 | |
| WLMC(Base,Post)=(PN,PN), Base Predictor=DecisionTree2026.05 | 4.25 | 21.75 | 1.08 | 4.25 | 21.75 | 1.08 | 84.12 | |
| Platt(Base, Post)=(PN, Pconf), Base Predictor=LogisticRegression2026.05 | 4.27 | 15.29 | 0.74 | 3.37 | 11.59 | 1.17 | 85.86 | |
| PlattDistribution (Base,Post)=(PN,PN), Base Predictor=MLP2026.05 | 4.32 | 11.25 | 1.33 | 4.32 | 11.25 | 1.33 | 86.39 | |
| Platt(Base, Post)=(Pconf, Pconf), Base Predictor=LogisticRegression2026.05 | 4.45 | 12.27 | 1.09 | 3.71 | 8.69 | 1.34 | 84.43 | |
| PlattBase Predictor=SVM, (Base, Post)=(PN,PU)2026.05 | 4.54 | 25.93 | 2.47 | 5.05 | 26.95 | 2.61 | 84.69 | |
| WLMC(Base,Post)=(PN,PU), Base Predictor=DecisionTree2026.05 | 4.58 | 23.46 | 1.17 | 6 | 27.94 | 1.54 | 84.04 | |
| Platt(Base, Post)=(PN, PN), Base Predictor=LogisticRegression2026.05 | 4.61 | 12.62 | 1.46 | 4.61 | 12.62 | 1.46 | 86.11 | |
| WLMC(Base,Post)=(PU,PU), Base Predictor=RandomForest2026.05 | 4.67 | 15.77 | 1.2 | 5.78 | 20.74 | 1.4 | 83.15 | |
| PlattDistribution (Base,Post)=(Pconf,Pconf), Base Predictor=MLP2026.05 | 4.71 | 15.6 | 0.94 | 4.97 | 15.64 | 2.24 | 85.8 | |
| WLMC(Base,Post)=(PN,UU), Base Predictor=DecisionTree2026.05 | 4.96 | 20.21 | 1.26 | 5.49 | 24.84 | 1.39 | 84.23 | |
| WLMC(Base,Post)=(PU,PU), Base Predictor=DecisionTree2026.05 | 5.29 | 19.7 | 1.36 | 6.49 | 24.41 | 1.61 | 83.34 | |
| WLMCBase Predictor=NaiveBayes, (Base, Post) setting=(PN,PN)2026.05 | 5.33 | 13.99 | 1.17 | 5.33 | 13.99 | 1.17 | 81.94 | |
| TempBase Predictor=SVM, (Base, Post)=(UU,UU)2026.05 | 5.36 | 26.9 | 5.76 | 5.49 | 30.59 | 5.86 | 84.05 | |
| WLMCBase Predictor=SVM, (Base, Post)=(PN,UU)2026.05 | 5.66 | 19.05 | 1.72 | 6.3 | 23.6 | 1.79 | 85.64 | |
| WLMCBase Predictor=NaiveBayes, (Base, Post) setting=(PU,PU)2026.05 | 5.68 | 16.94 | 1.41 | 6.43 | 18.4 | 1.7 | 81.84 | |
| Platt(Base,Post)=(PU,PU), Base Predictor=DecisionTree2026.05 | 5.68 | 32.66 | 3.73 | 5.19 | 30.2 | 3.58 | 82.62 | |
| PlattBase Predictor=SVM, (Base, Post)=(UU,UU)2026.05 | 5.85 | 37.32 | 3.09 | 5.83 | 39.09 | 3.28 | 83.48 | |
| WLMCBase Predictor=NaiveBayes, (Base, Post) setting=(PN,UU)2026.05 | 6.02 | 17.67 | 1.26 | 6.24 | 18.94 | 1.52 | 82.24 | |
| WLMCBase Predictor=SVM, (Base, Post)=(PN,PU)2026.05 | 6.11 | 20.09 | 1.72 | 7.03 | 23.7 | 1.89 | 85.14 | |
| WLMCBase Predictor=NaiveBayes, (Base, Post) setting=(PN,PU)2026.05 | 6.12 | 16.83 | 1.44 | 6.91 | 20.23 | 1.78 | 82.33 | |
| WLMCBase Predictor=SVM, (Base, Post)=(PN,PN)2026.05 | 6.15 | 19.46 | 1.82 | 6.15 | 19.46 | 1.82 | 85.72 | |
| PlattBase Predictor=SVM, (Base, Post)=(PN,Pconf)2026.05 | 6.98 | 29.71 | 2.48 | 5.81 | 25.06 | 3.18 | 85.05 | |
| Platt(Base,Post)=(PN,PU), Base Predictor=DecisionTree2026.05 | 6.98 | 32.45 | 4 | 7.09 | 31.06 | 3.85 | 82.65 | |
| WLMCBase Predictor=SVM, (Base, Post)=(UU,UU)2026.05 | 7.08 | 30.22 | 2.35 | 7.57 | 35.04 | 2.5 | 83.91 | |
| Platt(Base,Post)=(PN,UU), Base Predictor=DecisionTree2026.05 | 7.12 | 31.8 | 4.03 | 6.97 | 33.58 | 4.08 | 82.69 | |
| WLMC(Base,Post)=(PN,Pconf), Base Predictor=DecisionTree2026.05 | 7.16 | 26.23 | 1.45 | 8.1 | 29.51 | 2.42 | 83.84 | |
| PlattBase Predictor=SVM, (Base, Post)=(PU,PU)2026.05 | 7.35 | 29.81 | 6.36 | 7.47 | 29.76 | 6.26 | 80.38 | |
| Platt(Base,Post)=(PN,Pconf), Base Predictor=DecisionTree2026.05 | 7.42 | 36.12 | 2.43 | 7.31 | 34.65 | 4.4 | 82.82 | |
| WLMC(Base,Post)=(Pconf,Pconf), Base Predictor=RandomForest2026.05 | 7.69 | 15.28 | 1.49 | 12.68 | 25.52 | 3.51 | 83.02 | |
| WLMCDistribution (Base,Post)=(Pconf,Pconf), Base Predictor=MLP2026.05 | 7.75 | 15.09 | 1.23 | 11.83 | 22.05 | 2.52 | 84.63 | |
| WLMC(Base,Post)=(UU,UU), Base Predictor=RandomForest2026.05 | 7.82 | 20.22 | 1.69 | 8.06 | 24.09 | 1.8 | 79.61 | |
| TempBase Predictor=SVM, (Base, Post)=(PN,UU)2026.05 | 7.97 | 21.47 | 5.58 | 8.16 | 24.35 | 5.64 | 85.74 | |
| PlattBase Predictor=SVM, (Base, Post)=(Pconf,Pconf)2026.05 | 7.97 | 32.6 | 2.95 | 7.08 | 32.88 | 5.37 | 82.62 | |
| TempBase Predictor=SVM, (Base, Post)=(PN,PU)2026.05 | 8.6 | 20.97 | 5.96 | 8.89 | 23.48 | 5.86 | 85.74 | |
| WLMCBase Predictor=SVM, (Base, Post)=(PN,Pconf)2026.05 | 8.61 | 23.78 | 2.43 | 10.81 | 31.33 | 2.76 | 85.77 | |
| ERM(Base,Post)=(PN,PN), Base Predictor=DecisionTree2026.05 | 8.74 | 30.21 | 1.82 | 8.74 | 30.21 | 1.82 | 83.82 |