Toxicity Classification on CivilComments (CC) (test)
79.66Worst-Group AccuracygDRO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| gDROms=0.55, mt=0.652022.11 | 79.66 | 84.46 | |
| LA/TTLSAms=0.55, mt=0.652022.11 | 79.27 | 85.03 | |
| SUBGms=0.55, mt=0.652022.11 | 76.56 | 79.56 | |
| FGDRO-KLModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 69.21 | 77.34 | |
| ERMms=0.55, mt=0.652022.11 | 68.16 | 88 | |
| FGDRO-CVaRModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 66.93 | 75.71 | |
| FGDRO-KL-AdamModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 66.28 | 76.14 | |
| FedAdamModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 65.67 | 76.64 | |
| SCAFFOLDModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 64.36 | 76.33 | |
| FedProxModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 64.3 | 76.92 | |
| FedAvgModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 64.15 | 76.35 | |
| DRFAModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 63.27 | 74.13 | |
| DR-DSGDModel=DistilBERT, Local iterations=20K, Batch size=322024.10 | 62.72 | 75.23 |