Robust Classification on CivilComments
72.6Worst-Group AccuracyLISA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LISAGroup labels in train set?=Yes2022.09 | 72.6 | 89.2 | |
| LISAGroup labels in train set?=Yes2022.09 | 72.6 | 89.2 | |
| FishGroup labels in train set?=Yes2022.09 | 71.1 | 89.8 | |
| FishGroup labels in train set?=Yes2022.09 | 71.1 | 89.8 | |
| LC2024.03 | 70.3 | — | |
| UMIXGroup labels in train set?=No2022.09 | 70.1 | 90.6 | |
| UMIXGroup labels in train set?=No2022.09 | 70.1 | 90.6 | |
| GroupDROGroup labels in train set?=Yes2022.09 | 70 | 89.9 | |
| GroupDROGroup labels in train set?=Yes2022.09 | 70 | 89.9 | |
| JTT2024.03 | 69.3 | — | |
| DeNetDM2024.03 | 68.33 | — | |
| IRMGroup labels in train set?=Yes2022.09 | 66.3 | 88.8 | |
| IRMGroup labels in train set?=Yes2022.09 | 66.3 | 88.8 | |
| CORALGroup labels in train set?=Yes2022.09 | 65.6 | 88.7 | |
| CORALGroup labels in train set?=Yes2022.09 | 65.6 | 88.7 | |
| IB-IRMGroup labels in train set?=Yes2022.09 | 65.3 | 89.1 | |
| IB-IRMGroup labels in train set?=Yes2022.09 | 65.3 | 89.1 | |
| V-RExGroup labels in train set?=Yes2022.09 | 64.9 | 90.2 | |
| V-REXGroup labels in train set?=Yes2022.09 | 64.9 | 90.2 | |
| DomainMixGroup labels in train set?=Yes2022.09 | 63.6 | 90.9 | |
| DomainMixGroup labels in train set?=Yes2022.09 | 63.6 | 90.9 | |
| ERM2024.03 | 58.6 | — | |
| LfF2024.03 | 58.3 | — |