Binary Classification on Binary CIFAR100 imbalance ratio 1:200 (test)
69.9FPR @ 98% TPRW-BCE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| W-BCEregularization=RankReg2023.03 | 69.9 | 51.4 | 41.6 | 84.3 | |
| LDAMregularization=RankReg2023.03 | 70.2 | 56.8 | 37.4 | 84.1 | |
| ALM + W-BCEBase Loss=W-BCE2021.02 | 79 | 62 | 44 | 81.3 | |
| W-BCEconstraint=ALM2023.03 | 79 | 62 | 44 | 81.3 | |
| S-FLregularization=RankReg2023.03 | 79.2 | 65.8 | 47.2 | 83.1 | |
| LDAM2021.02 | 80 | 67 | 45 | 82.1 | |
| LDAM2023.03 | 80 | 67 | 45 | 82.1 | |
| A-FLregularization=RankReg2023.03 | 81.2 | — | 37.8 | 83.7 | |
| S-MLregularization=RankReg2023.03 | 81.8 | 62.8 | 48.4 | 82.4 | |
| ALM + LDAMBase Loss=LDAM2021.02 | 84 | 61 | 46 | 81.5 | |
| LDAMconstraint=ALM2023.03 | 84 | 61 | 46 | 81.5 | |
| ALM + S-FLBase Loss=S-FL2021.02 | 85 | 76 | 50 | 80.8 | |
| ALM + CB-BCEBase Loss=CB-BCE2021.02 | 85 | 66 | 44 | 81 | |
| S-FLconstraint=ALM2023.03 | 85 | 76 | 50 | 80.8 | |
| CB-BCEconstraint=ALM2023.03 | 85 | 66 | 44 | 81 | |
| CB-BCEregularization=RankReg2023.03 | 85 | 64 | 40.4 | 81.4 | |
| BCEregularization=RankReg2023.03 | 85.2 | 66.8 | 43 | 83.1 | |
| A-MLregularization=RankReg2023.03 | 86.2 | 59 | 43 | 83.4 | |
| ALM + BCEBase Loss=BCE2021.02 | 87 | 66 | 57 | 80.9 | |
| ALM + S-MLBase Loss=S-ML2021.02 | 87 | 73 | 55 | 80.7 | |
| BCEconstraint=ALM2023.03 | 87 | 66 | 57 | 80.9 | |
| S-MLconstraint=ALM2023.03 | 87 | 73 | 55 | 80.7 | |
| MBAUC2021.02 | 88 | 63 | 48 | 80.3 | |
| ALM + A-FLBase Loss=A-FL2021.02 | 88 | 76 | 46 | 80.7 | |
| A-FLconstraint=ALM2023.03 | 88 | 76 | 46 | 80.7 | |
| S-FL2021.02 | 90 | 78 | 50 | 80.1 | |
| S-FL2023.03 | 90 | 78 | 50 | 80.1 | |
| A-FL2021.02 | 91 | 78 | 50 | 80 | |
| A-FL2023.03 | 91 | 78 | 50 | 80 | |
| ALM + A-MLBase Loss=A-ML2021.02 | 92 | 63 | 45 | 81 | |
| A-MLconstraint=ALM2023.03 | 92 | 63 | 45 | 81 | |
| CB-BCE2021.02 | 93 | 78 | 51 | 78.7 | |
| CB-BCE2023.03 | 93 | 78 | 51 | 78.7 | |
| BCE2021.02 | 94 | 77 | 61 | 79.1 | |
| BCE2023.03 | 94 | 77 | 61 | 79.1 | |
| S-ML2021.02 | 95 | 75 | 64 | 79.7 | |
| A-ML2021.02 | 95 | 75 | 66 | 79.8 | |
| W-BCE2021.02 | 95 | 63 | 51 | 79.7 | |
| S-ML2023.03 | 95 | 75 | 64 | 79.7 | |
| A-ML2023.03 | 95 | 75 | 66 | 79.8 | |
| W-BCE2023.03 | 95 | 63 | 51 | 79.7 |