Comment Classification on Civil Comments
92.2AccuracyERM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERMSetting=group-oblivious2022.09 | 92.2 | — | 56 | |
| Focal LossSetting=group-oblivious2022.09 | 91.2 | — | 60.1 | |
| DomainMixGroup labels in train set=Yes2022.09 | 90.9 | — | 63.6 | |
| JTTSetting=group-oblivious2022.09 | 90.7 | — | 67.4 | |
| UMIXGroup labels in train set=No2022.09 | 90.6 | — | 70.1 | |
| V-RExGroup labels in train set=Yes2022.09 | 90.2 | — | 64.9 | |
| x2-DOROSetting=group-oblivious2022.09 | 90.1 | — | 63.8 | |
| CVaR-DOROSetting=group-oblivious2022.09 | 90 | — | 64.1 | |
| GroupDROGroup labels in train set=Yes2022.09 | 89.9 | — | 70 | |
| FishGroup labels in train set=Yes2022.09 | 89.8 | — | 71.1 | |
| x2-DROSetting=group-oblivious2022.09 | 89.4 | — | 64.2 | |
| LISAGroup labels in train set=Yes2022.09 | 89.2 | — | 72.6 | |
| CVaR-DROSetting=group-oblivious2022.09 | 89.1 | — | 62.3 | |
| IB-IRMGroup labels in train set=Yes2022.09 | 89.1 | — | 65.3 | |
| IRMGroup labels in train set=Yes2022.09 | 88.8 | — | 66.3 | |
| CORALGroup labels in train set=Yes2022.09 | 88.7 | — | 65.6 | |
| CharformerModel=Base2021.06 | 83 | 78.8 | — | |
| CharformerModel=SBase2021.06 | 83 | 78.9 | — | |
| Byte-level T5+LASCModel=Base2021.06 | 82.9 | 78.2 | — | |
| Byte-level T5Model=Base2021.06 | 82.8 | 78.7 | — | |
| T5Model=Base, Subword2021.06 | 81.2 | — | — | |
| CARE-SVD2026.02 | 77.8 | — | — | |
| CARE-Tensor2026.02 | 74.9 | — | — | |
| WS2026.02 | 73.9 | — | — | |
| Dawid–Skene2026.02 | 73.5 | — | — | |
| MACE2026.02 | 73.2 | — | — | |
| UWS2026.02 | 71.3 | — | — | |
| GLAD2026.02 | 69.5 | — | — | |
| MV2026.02 | 69.1 | — | — | |
| AVG2026.02 | 69 | — | — |