Income Prediction on ACSIncome (test)
0.74Oracle ECETemp
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| TempBase Predictor=RandomForest, (Base, Post) setting=(PN,UU)2026.05 | 0.74 | 5.51 | 0.13 | 1.02 | 10.52 | 0.17 | 81.7 | |
| PlattBase Predictor=RandomForest, (Base, Post) setting=(PN,UU)2026.05 | 0.79 | 5.5 | 0.13 | 1.12 | 10.59 | 0.16 | 81.69 | |
| TempBase Predictor=RandomForest, (Base, Post) setting=(PN,PU)2026.05 | 0.87 | 5.56 | 0.13 | 1.53 | 14.79 | 0.27 | 81.7 | |
| PlattBase Predictor=RandomForest, (Base, Post) setting=(PN,PU)2026.05 | 0.88 | 5.53 | 0.13 | 1.5 | 14.76 | 0.26 | 81.7 | |
| WLMCBase predictor=LogisticRegression, (Base, Post)=(PN, PU), step size=0.05, max updates=502026.05 | 0.92 | 7.64 | 0.3 | 1.56 | 15.74 | 0.4 | 77.02 | |
| ERMBase predictor=LogisticRegression, (Base, Post)=(PN, PN)2026.05 | 0.93 | 7.6 | 0.31 | 0.93 | 7.6 | 0.31 | 77.02 | |
| WLMCBase predictor=LogisticRegression, (Base, Post)=(PN, PN), step size=0.05, max updates=502026.05 | 0.93 | 7.6 | 0.31 | 0.93 | 7.6 | 0.31 | 77.02 | |
| PlattBase predictor=LogisticRegression, (Base, Post)=(PN, PU)2026.05 | 0.93 | 7.2 | 0.35 | 1.62 | 14.97 | 0.45 | 77 | |
| WLMCBase predictor=LogisticRegression, (Base, Post)=(PN, UU), step size=0.05, max updates=502026.05 | 0.93 | 7.62 | 0.31 | 1.19 | 11.83 | 0.33 | 77.02 | |
| PlattBase Predictor=MLP, (Base, Post) Setup=(PN,UU), Post-processing=Platt2026.05 | 0.94 | 6.53 | 0.16 | 1.19 | 11 | 0.19 | 80.75 | |
| PlattBase predictor=LogisticRegression, (Base, Post)=(PN, UU)2026.05 | 0.95 | 7.13 | 0.36 | 1.16 | 11.39 | 0.38 | 77.01 | |
| PlattBase Predictor=MLP, (Base, Post) Setup=(PN,PU), Post-processing=Platt2026.05 | 0.95 | 6.44 | 0.15 | 1.47 | 13.48 | 0.26 | 80.76 | |
| ERMBase Predictor=RandomForest, (Base, Post) setting=(PN,PN)2026.05 | 0.96 | 5.39 | 0.16 | 0.96 | 5.39 | 0.16 | 81.7 | |
| WLMCBase Predictor=RandomForest, (Base, Post) setting=(PN,PN)2026.05 | 0.96 | 5.39 | 0.16 | 0.96 | 5.39 | 0.16 | 81.7 | |
| WLMCBase Predictor=RandomForest, (Base, Post) setting=(PN,PU)2026.05 | 0.96 | 5.39 | 0.16 | 1.56 | 13.88 | 0.25 | 81.7 | |
| WLMCBase Predictor=RandomForest, (Base, Post) setting=(PN,Pconf)2026.05 | 0.96 | 5.39 | 0.16 | 0.26 | 1.74 | 0.06 | 81.7 | |
| TempBase Predictor=RandomForest, (Base, Post) setting=(PN,Pconf)2026.05 | 0.96 | 5.39 | 0.16 | 0.26 | 1.73 | 0.06 | 81.7 | |
| WLMCBase Predictor=RandomForest, (Base, Post) setting=(PN,UU)2026.05 | 0.96 | 5.39 | 0.16 | 1.19 | 10.22 | 0.2 | 81.7 | |
| PlattBase Predictor=RandomForest, (Base, Post) setting=(PN,Pconf)2026.05 | 0.97 | 5.28 | 0.16 | 0.19 | 1.65 | 0.05 | 81.7 | |
| TempBase predictor=LogisticRegression, (Base, Post)=(PN, PU)2026.05 | 0.98 | 7.79 | 0.31 | 1.63 | 16.24 | 0.42 | 77.02 | |
| TempBase predictor=LogisticRegression, (Base, Post)=(PN, UU)2026.05 | 1 | 7.62 | 0.32 | 1.23 | 11.8 | 0.33 | 77.02 | |
| TempBase Predictor=MLP, (Base, Post) Setup=(PN,UU), Post-processing=Temp2026.05 | 1.21 | 6.7 | 0.2 | 1.41 | 11.16 | 0.24 | 80.77 | |
| TempBase Predictor=MLP, (Base, Post) Setup=(PN,PU), Post-processing=Temp2026.05 | 1.23 | 6.71 | 0.18 | 1.74 | 13.8 | 0.3 | 80.77 | |
| TempBase Predictor=MLP, (Base, Post) Setup=(PN,Pconf), Post-processing=Temp2026.05 | 1.28 | 6.71 | 0.21 | 1.63 | 5.69 | 0.29 | 80.77 | |
| TempBase predictor=LogisticRegression, (Base, Post)=(PN, Pconf)2026.05 | 1.36 | 7.37 | 0.29 | 1.99 | 26.44 | 0.5 | 77.02 | |
| WLMCBase Predictor=MLP, (Base, Post) Setup=(PN,Pconf), Post-processing=WLMC, Step size=0.05, Max updates=502026.05 | 1.37 | 6.71 | 0.21 | 1.72 | 5.9 | 0.26 | 80.77 | |
| ERMBase Predictor=MLP, (Base, Post) Setup=(PN,PN), Post-processing=ERM2026.05 | 1.4 | 6.76 | 0.21 | 1.39 | 6.76 | 0.21 | 80.77 | |
| WLMCBase Predictor=MLP, (Base, Post) Setup=(PN,PN), Post-processing=WLMC, Step size=0.05, Max updates=502026.05 | 1.4 | 6.76 | 0.21 | 1.39 | 6.76 | 0.21 | 80.77 | |
| WLMCBase Predictor=MLP, (Base, Post) Setup=(PN,UU), Post-processing=WLMC, Step size=0.05, Max updates=502026.05 | 1.4 | 6.76 | 0.21 | 1.5 | 11.4 | 0.25 | 80.77 | |
| WLMCBase Predictor=MLP, (Base, Post) Setup=(PN,PU), Post-processing=WLMC, Step size=0.05, Max updates=502026.05 | 1.42 | 6.78 | 0.21 | 1.88 | 13.9 | 0.31 | 80.77 | |
| WLMCBase predictor=LogisticRegression, (Base, Post)=(PN, Pconf), step size=0.05, max updates=502026.05 | 1.45 | 7.24 | 0.51 | 1.89 | 22.17 | 0.49 | 77.02 | |
| PlattBase Predictor=MLP, (Base, Post) Setup=(PN,Pconf), Post-processing=Platt2026.05 | 1.49 | 5.95 | 0.18 | 0.96 | 5.03 | 0.24 | 80.68 | |
| WLMCBase predictor=LogisticRegression, (Base, Post)=(UU, UU), step size=0.05, max updates=502026.05 | 1.94 | 10.46 | 0.48 | 2.1 | 13.9 | 0.48 | 74.19 | |
| PlattBase predictor=LogisticRegression, (Base, Post)=(PN, Pconf)2026.05 | 2.28 | 7.28 | 0.45 | 2.18 | 24.3 | 0.58 | 76.89 | |
| WLMCBase predictor=LogisticRegression, (Base, Post)=(PU, PU), step size=0.05, max updates=502026.05 | 2.28 | 10.42 | 0.48 | 2.58 | 17.5 | 0.54 | 73.78 | |
| PlattBase Predictor=MLP, (Base, Post) Setup=(UU,UU), Post-processing=Platt2026.05 | 2.31 | 7.37 | 0.32 | 2.32 | 11.88 | 0.33 | 78.65 | |
| PlattBase predictor=LogisticRegression, (Base, Post)=(PN, PN)2026.05 | 2.35 | 7.97 | 0.52 | 2.35 | 7.97 | 0.52 | 77 | |
| WLMCBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, Pconf)2026.05 | 2.39 | 7.4 | 0.37 | 2.93 | 10.65 | 0.37 | 80.13 | |
| WLMCBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, PU)2026.05 | 2.46 | 7.38 | 0.37 | 2.72 | 15.34 | 0.41 | 80.14 | |
| PlattBase predictor=DecisionTree, (Base, Post) supervision setting=(Pconf, Pconf)2026.05 | 2.47 | 6.22 | 0.35 | 3.15 | 23.87 | 0.78 | 80.17 | |
| ERMBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, PN)2026.05 | 2.48 | 7.42 | 0.37 | 2.48 | 7.43 | 0.37 | 80.07 | |
| WLMCBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, PN)2026.05 | 2.48 | 7.42 | 0.37 | 2.48 | 7.43 | 0.37 | 80.13 | |
| WLMCBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, UU)2026.05 | 2.48 | 7.42 | 0.37 | 2.61 | 11.57 | 0.43 | 80.13 | |
| PlattBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, PN)2026.05 | 2.69 | 7.11 | 0.7 | 2.68 | 7.1 | 0.7 | 80.13 | |
| TempBase Predictor=MLP, (Base, Post) Setup=(PN,PN), Post-processing=Temp2026.05 | 2.72 | 7.26 | 0.37 | 2.72 | 7.26 | 0.37 | 80.77 | |
| PlattBase Predictor=RandomForest, (Base, Post) setting=(PN,PN)2026.05 | 2.77 | 5.88 | 0.54 | 2.77 | 5.88 | 0.54 | 81.69 | |
| PlattBase predictor=LogisticRegression, (Base, Post)=(UU, UU)2026.05 | 2.92 | 11.75 | 0.91 | 2.95 | 15.54 | 0.91 | 74.15 | |
| WLMCBase Predictor=MLP, (Base, Post) Setup=(UU,UU), Post-processing=WLMC, Step size=0.05, Max updates=502026.05 | 2.96 | 9.2 | 0.32 | 3.04 | 13.41 | 0.37 | 78.8 | |
| TempBase Predictor=MLP, (Base, Post) Setup=(UU,UU), Post-processing=Temp2026.05 | 2.97 | 9.24 | 0.41 | 2.96 | 13.32 | 0.44 | 78.8 | |
| PlattBase Predictor=MLP, (Base, Post) Setup=(PN,PN), Post-processing=Platt2026.05 | 2.98 | 6.43 | 0.59 | 2.99 | 6.43 | 0.59 | 80.74 | |
| PlattBase predictor=LogisticRegression, (Base, Post)=(Pconf, Pconf)2026.05 | 3.03 | 9.63 | 0.62 | 3.53 | 64.39 | 1.45 | 74.6 | |
| WLMCBase predictor=DecisionTree, (Base, Post) supervision setting=(UU, UU)2026.05 | 3.05 | 9.1 | 0.42 | 3.13 | 11.5 | 0.42 | 79.39 | |
| PlattBase Predictor=MLP, (Base, Post) Setup=(PU,PU), Post-processing=Platt2026.05 | 3.1 | 8.62 | 0.35 | 3.34 | 14.8 | 0.39 | 77.93 | |
| TempBase predictor=LogisticRegression, (Base, Post)=(UU, UU)2026.05 | 3.21 | 13.14 | 0.96 | 3.25 | 17.04 | 0.97 | 74.16 | |
| PlattDistribution Setting (Base, Post)=(PN,PN), Base Predictor=NaiveBayes2026.05 | 3.32 | 10.02 | 0.63 | 3.32 | 10.02 | 0.63 | 76.52 | |
| ERMBase Predictor=MLP, (Base, Post) Setup=(UU,UU), Post-processing=ERM2026.05 | 3.38 | 9.63 | 0.53 | 3.46 | 13.82 | 0.56 | 78.8 | |
| ERMBase predictor=LogisticRegression, (Base, Post)=(UU, UU)2026.05 | 3.48 | 13.91 | 1.1 | 3.52 | 17.35 | 1.1 | 74.16 | |
| ERMBase predictor=DecisionTree, (Base, Post) supervision setting=(UU, UU)2026.05 | 3.59 | 9.54 | 0.58 | 3.65 | 11.54 | 0.57 | 79.39 | |
| WLMCBase Predictor=MLP, (Base, Post) Setup=(PU,PU), Post-processing=WLMC, Step size=0.05, Max updates=502026.05 | 3.67 | 9.8 | 0.48 | 3.84 | 15.93 | 0.51 | 78.24 | |
| PlattBase predictor=LogisticRegression, (Base, Post)=(PU, PU)2026.05 | 3.82 | 12.3 | 1.13 | 4.14 | 18.05 | 1.17 | 73.69 | |
| TempBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, Pconf)2026.05 | 3.86 | 8.73 | 0.43 | 3.58 | 20.36 | 0.55 | 80.13 | |
| PlattBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, Pconf)2026.05 | 3.94 | 8.2 | 0.46 | 3.68 | 19.55 | 0.53 | 80.11 | |
| TempBase Predictor=MLP, (Base, Post) Setup=(PU,PU), Post-processing=Temp2026.05 | 3.96 | 10.65 | 0.49 | 4.05 | 16.59 | 0.52 | 78.24 | |
| TempBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, PU)2026.05 | 4 | 9.1 | 0.47 | 4.28 | 17.96 | 0.5 | 80.13 | |
| PlattBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, PU)2026.05 | 4.07 | 8.49 | 0.46 | 4.28 | 17.66 | 0.5 | 80.13 | |
| PlattBase Predictor=RandomForest, (Base, Post) setting=(Pconf,Pconf)2026.05 | 4.14 | 8.59 | 0.48 | 4.17 | 28.59 | 0.97 | 80.63 | |
| TempBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, UU)2026.05 | 4.17 | 9.26 | 0.49 | 4.19 | 13.99 | 0.49 | 80.13 | |
| WLMCBase predictor=DecisionTree, (Base, Post) supervision setting=(PU, PU)2026.05 | 4.17 | 11.28 | 0.48 | 4.29 | 16.75 | 0.53 | 78.43 | |
| ERMBase Predictor=MLP, (Base, Post) Setup=(PU,PU), Post-processing=ERM2026.05 | 4.23 | 10.51 | 0.51 | 4.36 | 16.16 | 0.52 | 78.24 | |
| PlattBase predictor=DecisionTree, (Base, Post) supervision setting=(PN, UU)2026.05 | 4.25 | 8.66 | 0.48 | 4.3 | 13.13 | 0.49 | 80.13 | |
| TempBase predictor=LogisticRegression, (Base, Post)=(PU, PU)2026.05 | 4.32 | 14.22 | 1.17 | 4.61 | 19.72 | 1.21 | 73.63 | |
| ERMBase predictor=LogisticRegression, (Base, Post)=(PU, PU)2026.05 | 4.52 | 14.59 | 1.28 | 4.75 | 20.16 | 1.3 | 73.63 | |
| PlattBase Predictor=MLP, (Base, Post) Setup=(Pconf,Pconf), Post-processing=Platt2026.05 | 4.66 | 7.4 | 0.57 | 5 | 34.78 | 0.97 | 78.65 | |
| WLMCBase Predictor=MLP, (Base, Post) Setup=(Pconf,Pconf), Post-processing=WLMC, Step size=0.05, Max updates=502026.05 | 4.72 | 10.83 | 0.55 | 5.56 | 19.21 | 0.75 | 79.08 | |
| PlattDistribution Setting (Base, Post)=(PN,Pconf), Base Predictor=NaiveBayes2026.05 | 5.47 | 9.94 | 0.95 | 5.79 | 60.05 | 1.01 | 76.8 | |
| ERMBase predictor=DecisionTree, (Base, Post) supervision setting=(PU, PU)2026.05 | 5.6 | 12.86 | 1.01 | 5.77 | 17.29 | 1.01 | 78.41 | |
| TempRegime (Base,Post)=(PN,UU), Base Predictor=SVM2026.05 | 5.95 | 14.86 | 2.97 | 6.02 | 16.53 | 2.99 | 66.82 | |
| TempRegime (Base,Post)=(PN,PU), Base Predictor=SVM2026.05 | 6.06 | 14.9 | 3 | 6.11 | 15.72 | 3.09 | 66.82 | |
| PlattDistribution Setting (Base, Post)=(PN,PU), Base Predictor=NaiveBayes2026.05 | 6.13 | 10.38 | 0.73 | 6.35 | 16.24 | 0.76 | 76.65 | |
| WLMCDistribution Setting (Base, Post)=(UU,UU), Base Predictor=NaiveBayes2026.05 | 6.16 | 12.08 | 0.42 | 6.12 | 15.72 | 0.44 | 76.63 | |
| PlattDistribution Setting (Base, Post)=(UU,UU), Base Predictor=NaiveBayes2026.05 | 6.17 | 10.29 | 0.74 | 6.09 | 14.41 | 0.77 | 76.65 | |
| PlattDistribution Setting (Base, Post)=(PN,UU), Base Predictor=NaiveBayes2026.05 | 6.19 | 10.23 | 0.72 | 6.13 | 14.41 | 0.75 | 76.66 | |
| WLMCBase predictor=LogisticRegression, (Base, Post)=(Pconf, Pconf), step size=0.05, max updates=502026.05 | 6.24 | 14.04 | 0.69 | 7.56 | 34.59 | 1.19 | 72.91 | |
| WLMCDistribution Setting (Base, Post)=(PN,UU), Base Predictor=NaiveBayes2026.05 | 6.26 | 12.19 | 0.45 | 6.23 | 15.94 | 0.47 | 76.62 | |
| WLMCDistribution Setting (Base, Post)=(PN,PN), Base Predictor=NaiveBayes, step size=0.05, max updates=502026.05 | 6.31 | 12.17 | 0.46 | 6.31 | 12.17 | 0.46 | 76.67 | |
| PlattDistribution Setting (Base, Post)=(PU,PU), Base Predictor=NaiveBayes2026.05 | 6.36 | 10.37 | 0.77 | 6.55 | 15.74 | 0.79 | 76.66 | |
| WLMCDistribution Setting (Base, Post)=(PN,PU), Base Predictor=NaiveBayes2026.05 | 6.37 | 12.56 | 0.51 | 6.25 | 19.64 | 0.58 | 76.55 | |
| PlattDistribution Setting (Base, Post)=(Pconf,Pconf), Base Predictor=NaiveBayes2026.05 | 6.41 | 9.84 | 0.82 | 6.16 | 83.53 | 1.25 | 76.33 | |
| WLMCDistribution Setting (Base, Post)=(PU,PU), Base Predictor=NaiveBayes2026.05 | 6.53 | 12.52 | 0.5 | 6.41 | 18.82 | 0.59 | 76.48 | |
| WLMCBase Predictor=RandomForest, (Base, Post) setting=(Pconf,Pconf)2026.05 | 6.73 | 12.17 | 0.61 | 7.24 | 16.64 | 0.82 | 79.44 | |
| WLMCBase Predictor=RandomForest, (Base, Post) setting=(UU,UU)2026.05 | 6.98 | 13.28 | 0.49 | 7.06 | 17.11 | 0.51 | 78.4 | |
| WLMCDistribution Setting (Base, Post)=(PN,Pconf), Base Predictor=NaiveBayes2026.05 | 7.18 | 11.33 | 1.02 | 7.61 | 39.25 | 0.8 | 76.53 | |
| TempDistribution Setting (Base, Post)=(PN,Pconf), Base Predictor=NaiveBayes2026.05 | 7.4 | 14.44 | 0.92 | 8.38 | 84.16 | 1.41 | 75.34 | |
| WLMCBase predictor=DecisionTree, (Base, Post) supervision setting=(Pconf, Pconf)2026.05 | 7.41 | 13.32 | 0.61 | 8.09 | 23.26 | 0.67 | 78.2 | |
| TempRegime (Base,Post)=(PN,Pconf), Base Predictor=SVM2026.05 | 7.46 | 14.84 | 3.09 | 7.32 | 118.66 | 3.31 | 66.82 | |
| TempDistribution Setting (Base, Post)=(PN,PU), Base Predictor=NaiveBayes2026.05 | 7.69 | 14.66 | 0.97 | 7.84 | 20.14 | 1.04 | 75.34 | |
| TempDistribution Setting (Base, Post)=(PN,UU), Base Predictor=NaiveBayes2026.05 | 7.72 | 14.73 | 0.98 | 7.64 | 18.38 | 1 | 75.34 | |
| TempDistribution Setting (Base, Post)=(UU,UU), Base Predictor=NaiveBayes2026.05 | 7.73 | 14.8 | 0.98 | 7.64 | 18.4 | 1 | 75.29 | |
| TempDistribution Setting (Base, Post)=(PU,PU), Base Predictor=NaiveBayes2026.05 | 7.89 | 14.64 | 0.99 | 8.04 | 20 | 1.06 | 75.31 | |
| WLMCDistribution Setting (Base, Post)=(Pconf,Pconf), Base Predictor=NaiveBayes2026.05 | 8.49 | 13.25 | 1.21 | 8.47 | 47.96 | 1.12 | 74.75 |