Classification on CivilComments WILDS
85.5Average AccuracyIRM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IRMBackbone=BERT, Pre-trained=Yes, Selection Criteria=Worst group accuracy2024.11 | 85.5 | 63.2 | |
| ERMBackbone=BERT, Pre-trained=Yes, Selection Criteria=Worst group accuracy2024.11 | 85.4 | 63.7 | |
| GroupDRO + SCBackbone=BERT, Pre-trained=Yes, Selection Criteria=Worst group accuracy2024.11 | 82 | 0 | |
| GroupDROBackbone=BERT, Pre-trained=Yes, Selection Criteria=Worst group accuracy2024.11 | 81.8 | 70.6 | |
| CeGDROBackbone=BERT, Pre-trained=Yes, Selection Criteria=Worst group accuracy2024.11 | 80.4 | 73.5 | |
| CeGDRO - EFBackbone=BERT, Pre-trained=Yes, Selection Criteria=Worst group accuracy2024.11 | 78.7 | 71.4 |