Group-imbalanced Classification on Waterbirds (test)
15.5Balanced ErrorAutoBalance (Algo. 1)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AutoBalance (Algo. 1)lambda=0.12022.01 | 15.5 | 30.33 | 4.25 | |
| DROLoss function=DRO2022.01 | 16.47 | 32.67 | 6.91 | |
| CE_DEOLoss function=CE_DEO2022.01 | 19.32 | 33.04 | 25.33 | |
| Weighted CE + CE_DEOlambda=0.1, Loss function=0.9 CE + 0.1 CE_DEO2022.01 | 20.38 | 33.36 | 26.42 | |
| CE_balLoss function=Balanced Cross Entropy2022.01 | 21.09 | 36.63 | 20.61 | |
| Posthoc: Ebal (f)type=post-hoc, target=balanced error2022.01 | 21.15 | 42.83 | 32.3 | |
| Posthoc: 0.9 Ebal(f) + 0.1 EDEOtype=post-hoc, target=weighted balance error and DEO2022.01 | 21.56 | 44.13 | 29.37 | |
| Group-LA lossLoss function=Group-LA loss2022.01 | 22.91 | 40.27 | 29.34 | |
| Cross entropy (CE)Loss function=Cross entropy2022.01 | 25.37 | 46.69 | 33.75 |