Occupation Classification on Occupation Classification Balanced (test)
86.8AccuracyRLACE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| RLACEBackbone=DeBERTa, requires_demographics=true2022.12 | 86.8 | 12.6 | 80.8 | 1.361 | |
| RLACEBackbone=BERT, requires_demographics=true2022.12 | 86.6 | 13.1 | 80.9 | 1.413 | |
| ControlBackbone=DeBERTa2022.12 | 86.5 | 12.9 | 79.5 | 1.403 | |
| FinetunedBackbone=BERT2022.12 | 86.4 | 13.6 | 80.9 | 1.559 | |
| ControlBackbone=BERT2022.12 | 86.4 | 14 | 79.6 | 1.602 | |
| FinetunedBackbone=DeBERTa2022.12 | 86.4 | 13.4 | 81.9 | 1.597 | |
| ScrubbingBackbone=BERT, requires_demographics=true2022.12 | 86.3 | 12.3 | 70.4 | 0.901 | |
| ScrubbingBackbone=DeBERTa, requires_demographics=true2022.12 | 85.8 | 10.7 | 72.9 | 0.788 | |
| INLPBackbone=BERT, requires_demographics=true2022.12 | 85.3 | 13.1 | 78.2 | 1.216 | |
| INLPBackbone=DeBERTa, requires_demographics=true2022.12 | 85.2 | 12.2 | 73 | 1.05 | |
| JTTBackbone=BERT, demographics_for_tuning_only=true2022.12 | 84.6 | 13.6 | 76.1 | 1.417 | |
| BLIND + ScrubbingBackbone=BERT2022.12 | 84.4 | 13.2 | 66.4 | 1.07 | |
| BLIND + ScrubbingBackbone=DeBERTa2022.12 | 84.3 | 11.6 | 64.8 | 0.712 | |
| JTTBackbone=DeBERTa, demographics_for_tuning_only=true2022.12 | 84.1 | 14 | 77 | 1.398 | |
| DFL-demog + ScrubbingBackbone=DeBERTa, requires_demographics=true2022.12 | 84.1 | 11.4 | 57.8 | 0.592 | |
| BLINDBackbone=DeBERTa2022.12 | 83.5 | 12.3 | 63.8 | 0.906 | |
| DFL-demogBackbone=BERT, requires_demographics=true2022.12 | 83.4 | 12.2 | 60.2 | 0.709 | |
| DFL-demog + ScrubbingBackbone=BERT, requires_demographics=true2022.12 | 83 | 11.1 | 56.9 | 0.584 | |
| DFL-demogBackbone=DeBERTa, requires_demographics=true2022.12 | 82.9 | 11.3 | 61.9 | 0.794 | |
| BLINDBackbone=BERT2022.12 | 82.6 | 13.7 | 69.4 | 1.097 |