Occupation Classification on Bias-in-Bios
73.4Accuracy (Overall)EAR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| EARBackbone=RoBERTa-base2024.06 | 73.4 | — | — | — | — | 0.026 | |
| EARBackbone=BERT-base2024.06 | 72.7 | — | — | — | — | 0.017 | |
| Vanilla-tuningBackbone=BERT-base2024.06 | 72.2 | — | — | — | — | 0.018 | |
| MABELBackbone=RoBERTa-base2024.06 | 71.8 | — | — | — | — | 0.029 | |
| INLPBackbone=BERT-base2024.06 | 71.4 | — | — | — | — | 0.038 | |
| MABELBackbone=BERT-base2024.06 | 69.4 | — | — | — | — | 0.028 | |
| INLPBackbone=RoBERTa-base2024.06 | 69.3 | — | — | — | — | 0.016 | |
| Vanilla-tuningBackbone=RoBERTa-base2024.06 | 69.1 | — | — | — | — | 0.03 | |
| ProSocialTuningBackbone=RoBERTa-base2024.06 | 67.4 | — | — | — | — | 0.008 | |
| Debiased-tuningBackbone=BERT-base2024.06 | 66.8 | — | — | — | — | 0.013 | |
| ProSocialTuningBackbone=BERT-base2024.06 | 66.1 | — | — | — | — | 0.003 | |
| Debiased-tuningBackbone=RoBERTa-base2024.06 | 64.7 | — | — | — | — | 0.018 | |
| CCPAbase_model=BERT2023.07 | 0.8565 | 0.8541 | 0.8595 | 0.544 | 0.121 | — | |
| MABELbase_model=BERT2023.07 | 0.8485 | 0.8492 | 0.8434 | 0.599 | 0.132 | — | |
| BERT2023.07 | 0.8414 | 0.8469 | 0.835 | 1.189 | 0.144 | — | |
| Sent-Debiasbase_model=BERT2023.07 | 0.8356 | 0.841 | 0.8292 | 1.18 | 0.144 | — | |
| FairFilbase_model=BERT2023.07 | 0.8318 | 0.8352 | 0.8278 | 0.746 | 0.142 | — | |
| INLPbase_model=BERT2023.07 | 0.705 | — | — | — | 0.067 | — |