List your company

Toxicity Classification on CivilComments (CC) (test)

79.66Worst-Group AccuracygDRO
62.042466.616271.1975.7638Nov 28, 2022Mar 21, 2023Jul 12, 2023Nov 3, 2023Feb 24, 2024Jun 16, 2024Oct 8, 2024

Evaluation results

MethodLinks
gDROms=0.55, mt=0.652022.1179.6684.46
LA/TTLSAms=0.55, mt=0.652022.1179.2785.03
SUBGms=0.55, mt=0.652022.1176.5679.56
FGDRO-KLModel=DistilBERT, Local iterations=20K, Batch size=322024.1069.2177.34
ERMms=0.55, mt=0.652022.1168.1688
FGDRO-CVaRModel=DistilBERT, Local iterations=20K, Batch size=322024.1066.9375.71
FGDRO-KL-AdamModel=DistilBERT, Local iterations=20K, Batch size=322024.1066.2876.14
FedAdamModel=DistilBERT, Local iterations=20K, Batch size=322024.1065.6776.64
SCAFFOLDModel=DistilBERT, Local iterations=20K, Batch size=322024.1064.3676.33
FedProxModel=DistilBERT, Local iterations=20K, Batch size=322024.1064.376.92
FedAvgModel=DistilBERT, Local iterations=20K, Batch size=322024.1064.1576.35
DRFAModel=DistilBERT, Local iterations=20K, Batch size=322024.1063.2774.13
DR-DSGDModel=DistilBERT, Local iterations=20K, Batch size=322024.1062.7275.23