Binary Classification on CIFAR10 Binary imb. 200 (test)
0.7FPR @ 98% TPRALM + BCE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ALM + BCEOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.7 | 0.54 | 0.39 | 0.867 | |
| ALM + S-MLOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.72 | 0.52 | 0.39 | 0.879 | |
| ALM + LDAMOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.73 | 0.61 | 0.43 | 0.856 | |
| A-MLOptimization=Standard2021.02 | 0.74 | 0.56 | 0.39 | 0.874 | |
| ALM + S-FLOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.74 | 0.55 | 0.41 | 0.869 | |
| BCEOptimization=Standard2021.02 | 0.75 | 0.55 | 0.4 | 0.873 | |
| S-MLOptimization=Standard2021.02 | 0.75 | 0.54 | 0.35 | 0.874 | |
| ALM + A-MLOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.75 | 0.74 | 0.35 | 0.876 | |
| A-FLOptimization=Standard2021.02 | 0.76 | 0.59 | 0.4 | 0.862 | |
| S-FLOptimization=Standard2021.02 | 0.78 | 0.59 | 0.43 | 0.857 | |
| LDAMOptimization=Standard2021.02 | 0.78 | 0.63 | 0.45 | 0.864 | |
| ALM + A-FLOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.78 | 0.57 | 0.37 | 0.87 | |
| ALM + W-BCEOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.83 | 0.69 | 0.54 | 0.81 | |
| ALM + CB-BCEOptimization=Augmented Lagrangian Method (ALM)2021.02 | 0.85 | 0.69 | 0.53 | 0.8 | |
| CB-BCEOptimization=Standard2021.02 | 0.87 | 0.74 | 0.61 | 0.78 | |
| W-BCEOptimization=Standard2021.02 | 0.88 | 0.75 | 0.62 | 0.783 | |
| MBAUCOptimization=Standard2021.02 | 0.89 | 0.83 | 0.69 | 0.679 | |
| A-ML + RankRegBase Loss=A-ML, Regularization=RankReg2023.03 | 64.9 | 50.4 | 38.1 | 89.2 | |
| S-ML + RankRegBase Loss=S-ML, Regularization=RankReg2023.03 | 65.8 | 51.8 | 41.3 | 88.2 | |
| LDAM + RankRegBase Loss=LDAM, Regularization=RankReg2023.03 | 65.8 | 47.3 | 33.8 | 89.7 | |
| W-BCE + RankRegBase Loss=W-BCE, Regularization=RankReg2023.03 | 66.3 | 49.6 | 39.5 | 89.4 | |
| BCE + RankRegBase Loss=BCE, Regularization=RankReg2023.03 | 67.3 | 52.7 | 37.8 | 89.6 | |
| A-FL + RankRegBase Loss=A-FL, Regularization=RankReg2023.03 | 68.6 | 53.6 | 35.6 | 88.4 | |
| BCE + ALMBase Loss=BCE, Regularization=ALM2023.03 | 70 | 54 | 39 | 86.7 | |
| S-FL + RankRegBase Loss=S-FL, Regularization=RankReg2023.03 | 70.5 | 46.5 | 40.2 | 87.7 | |
| S-ML + ALMBase Loss=S-ML, Regularization=ALM2023.03 | 72 | 52 | 39 | 87.9 | |
| CB-BCE + RankRegBase Loss=CB-BCE, Regularization=RankReg2023.03 | 72 | 54.8 | 44.5 | 87.1 | |
| LDAM + ALMBase Loss=LDAM, Regularization=ALM2023.03 | 73 | 61 | 43 | 85.6 | |
| S-FL + ALMBase Loss=S-FL, Regularization=ALM2023.03 | 74 | 55 | 41 | 86.9 | |
| A-MLBase Loss=A-ML, Regularization=None2023.03 | 74 | 56 | 39 | 87.4 | |
| BCEBase Loss=BCE, Regularization=None2023.03 | 75 | 55 | 40 | 87.3 | |
| S-MLBase Loss=S-ML, Regularization=None2023.03 | 75 | 54 | 35 | 87.4 | |
| A-ML + ALMBase Loss=A-ML, Regularization=ALM2023.03 | 75 | 54 | 35 | 87.6 | |
| A-FLBase Loss=A-FL, Regularization=None2023.03 | 76 | 59 | 40 | 86.2 | |
| S-FLBase Loss=S-FL, Regularization=None2023.03 | 78 | 59 | 43 | 85.7 | |
| A-FL + ALMBase Loss=A-FL, Regularization=ALM2023.03 | 78 | 57 | 37 | 87 | |
| LDAMBase Loss=LDAM, Regularization=None2023.03 | 78 | 63 | 45 | 86.4 | |
| W-BCE + ALMBase Loss=W-BCE, Regularization=ALM2023.03 | 83 | 69 | 54 | 81 | |
| CB-BCE + ALMBase Loss=CB-BCE, Regularization=ALM2023.03 | 85 | 69 | 53 | 80 | |
| CB-BCEBase Loss=CB-BCE, Regularization=None2023.03 | 87 | 74 | 61 | 78 | |
| W-BCEBase Loss=W-BCE, Regularization=None2023.03 | 88 | 75 | 62 | 78.3 |