Racial Bias Evaluation on Multilingual CrowS-Pairs
16.37Bias Score (DE)XLM-R
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| XLM-RBase Model=XLM-R2026.04 | 16.37 | 0 | 11.67 | 3.33 | 7.84 | |
| CDABase Model=XLM-R2026.04 | 15.56 | 12.5 | 9.17 | 5.83 | 10.76 | |
| SDBase Model=XLM-R2026.04 | 15.49 | 0.83 | 3.33 | 1.67 | 5.33 | |
| Multiple-Debias (MD)Base Model=mBERT, Tuning Strategy=Adapter Tune2026.04 | 11.41 | 8.33 | 1.67 | 8.33 | 7.44 | |
| Multiple-Debias (MD)Base Model=mBERT, Tuning Strategy=Prompt Tune2026.04 | 10.56 | 5 | 1.67 | 5 | 5.56 | |
| Multiple-Debias (MD)Base Model=mBERT, Tuning Strategy=Prefix Tune2026.04 | 10.56 | 2.5 | 0 | 9.17 | 5.56 | |
| MSDBase Model=XLM-R2026.04 | 10.43 | 6.67 | 10 | 5 | 8.02 | |
| MCDABase Model=XLM-R2026.04 | 8.01 | 15.21 | 10.42 | 15.63 | 12.31 | |
| Multiple-Debias (MD)Base Model=XLM-R, Tuning Strategy=Adapter Tune2026.04 | 8.01 | 0.83 | 3.33 | 17.5 | 7.42 | |
| Multiple-Debias (MD)Base Model=XLM-R, Tuning Strategy=Prompt Tune2026.04 | 7.88 | 1.67 | 4.17 | 10 | 5.93 | |
| SDBase Model=mBERT2026.04 | 7.24 | 12.5 | 4.17 | 5.83 | 7.44 | |
| MCDABase Model=mBERT2026.04 | 5.71 | 10 | 5 | 7.92 | 7.16 | |
| MSDBase Model=mBERT2026.04 | 5.56 | 6.67 | 5.83 | 7.5 | 6.39 | |
| mBERTBase Model=mBERT2026.04 | 4.74 | 15 | 5 | 3.33 | 7.02 | |
| Multiple-Debias (MD)Base Model=mBERT, Tuning Strategy=Full Fine-Tune2026.04 | 2.93 | 6.67 | 3.33 | 8.33 | 5.32 | |
| CDABase Model=mBERT2026.04 | 2.01 | 1.67 | 12.5 | 20 | 9.04 | |
| Multiple-Debias (MD)Base Model=XLM-R, Tuning Strategy=Prefix Tune2026.04 | 0.56 | 13.33 | 14.17 | 12.5 | 10.14 | |
| Multiple-Debias (MD)Base Model=XLM-R, Tuning Strategy=Full Fine-Tune2026.04 | 0.53 | 17.5 | 10 | 21.67 | 12.43 |