Discrimination Risk Evaluation on Occupation-based Racial Discrimination dataset
0Risk Ratio (R)Ideally Unbiased
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Ideally Unbiased2024.02 | 0 | 0 | 0 | |
| BART2024.02 | 0.4178 | 0.2971 | 0.1207 | |
| OPT-IML2024.02 | 0.4234 | 0.4024 | 0.021 | |
| ALBERT2024.02 | 0.4314 | 0.4197 | 0.0117 | |
| GPT-22024.02 | 0.4927 | 0.4598 | 0.0329 | |
| ChatGLM22024.02 | 0.558 | 0.5177 | 0.0403 | |
| distilBERT2024.02 | 0.5614 | 0.5572 | 0.0042 | |
| Baichuan2024.02 | 0.5839 | 0.5503 | 0.0336 | |
| BERT2024.02 | 0.6174 | 0.6118 | 0.0056 | |
| T52024.02 | 0.6622 | 0.6407 | 0.0215 | |
| RoBERTa2024.02 | 0.7892 | 0.7549 | 0.0343 | |
| LLaMA22024.02 | 0.9313 | 0.9311 | 0.0002 | |
| XLNet2024.02 | 0.9333 | 0.912 | 0.0213 | |
| Stereotyped2024.02 | 1 | 1 | 0 | |
| Randomly Stereotyped2024.02 | 1 | 0 | 1 |