Binary Classification on Binary CIFAR100 (imbalance ratio 1:100) (test)
64FPR @ 98% TPRS-ML + RankReg
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| S-ML + RankRegBase Loss=S-ML, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 64 | 44.8 | 34.5 | 85.4 | |
| A-FL + RankRegBase Loss=A-FL, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 70 | 53.4 | 35.8 | 84.6 | |
| LDAM + RankRegBase Loss=LDAM, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 70.3 | 51.6 | 35 | 84.7 | |
| ALM + LDAMBase Loss=LDAM2021.02 | 80 | 59 | 40 | 83.2 | |
| LDAM + ALMBase Loss=LDAM, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 80 | 59 | 40 | 83.2 | |
| MBAUC2021.02 | 81 | 62 | 41 | 82.3 | |
| A-ML + RankRegBase Loss=A-ML, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 81.6 | 43.4 | 32.6 | 85.5 | |
| LDAM2021.02 | 84 | 70 | 42 | 82.8 | |
| W-BCE + RankRegBase Loss=W-BCE, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 84 | 60 | 41.1 | 82.9 | |
| LDAMBase Loss=LDAM, Regularization=None, Imbalance Ratio=1:1002023.03 | 84 | 70 | 42 | 82.3 | |
| S-FL + RankRegBase Loss=S-FL, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 84.6 | 49.2 | 38.4 | 84.7 | |
| BCE + RankRegBase Loss=BCE, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 85.2 | 42.4 | 28.7 | 85.5 | |
| ALM + A-FLBase Loss=A-FL2021.02 | 86 | 62 | 40 | 83.2 | |
| A-FL + ALMBase Loss=A-FL, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 86 | 62 | 40 | 83.2 | |
| ALM + W-BCEBase Loss=W-BCE2021.02 | 87 | 53 | 39 | 83.2 | |
| W-BCE + ALMBase Loss=W-BCE, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 87 | 53 | 39 | 83.2 | |
| A-FL2021.02 | 88 | 63 | 45 | 82.8 | |
| W-BCE2021.02 | 88 | 59 | 41 | 79.7 | |
| ALM + S-MLBase Loss=S-ML2021.02 | 88 | 69 | 41 | 81.7 | |
| ALM + S-FLBase Loss=S-FL2021.02 | 88 | 60 | 42 | 81.7 | |
| S-ML + ALMBase Loss=S-ML, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 88 | 69 | 41 | 81.7 | |
| S-FL + ALMBase Loss=S-FL, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 88 | 60 | 42 | 81.7 | |
| A-FLBase Loss=A-FL, Regularization=None, Imbalance Ratio=1:1002023.03 | 88 | 63 | 45 | 82.8 | |
| W-BCEBase Loss=W-BCE, Regularization=None, Imbalance Ratio=1:1002023.03 | 88 | 59 | 41 | 79.7 | |
| S-ML2021.02 | 89 | 65 | 43 | 82.7 | |
| S-FL2021.02 | 89 | 62 | 44 | 82.6 | |
| ALM + A-MLBase Loss=A-ML2021.02 | 89 | 55 | 37 | 82.7 | |
| ALM + CB-BCEBase Loss=CB-BCE2021.02 | 89 | 59 | 36 | 83.8 | |
| S-MLBase Loss=S-ML, Regularization=None, Imbalance Ratio=1:1002023.03 | 89 | 65 | 43 | 82.7 | |
| S-FLBase Loss=S-FL, Regularization=None, Imbalance Ratio=1:1002023.03 | 89 | 62 | 44 | 82.6 | |
| A-ML + ALMBase Loss=A-ML, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 89 | 55 | 37 | 82.7 | |
| CB-BCE + ALMBase Loss=CB-BCE, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 89 | 59 | 36 | 83.8 | |
| CB-BCE + RankRegBase Loss=CB-BCE, Regularization=RankReg, Imbalance Ratio=1:1002023.03 | 89.8 | 48.6 | 33.4 | 84.1 | |
| A-ML2021.02 | 91 | 63 | 44 | 81.8 | |
| ALM + BCEBase Loss=BCE2021.02 | 91 | 49 | 39 | 82.7 | |
| BCE + ALMBase Loss=BCE, Regularization=ALM, Imbalance Ratio=1:1002023.03 | 91 | 49 | 39 | 82.7 | |
| A-MLBase Loss=A-ML, Regularization=None, Imbalance Ratio=1:1002023.03 | 91 | 63 | 44 | 81.8 | |
| BCE2021.02 | 93 | 63 | 47 | 81.8 | |
| CB-BCE2021.02 | 93 | 75 | 52 | 78.8 | |
| BCEBase Loss=BCE, Regularization=None, Imbalance Ratio=1:1002023.03 | 93 | 63 | 47 | 81.8 | |
| CB-BCEBase Loss=CB-BCE, Regularization=None, Imbalance Ratio=1:1002023.03 | 93 | 75 | 52 | 78.8 |