Fairness metric evaluation on Bias in Bios (test)
0.206CorrelationP1
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| P1Weighting=Uniform w and v, Base Method=Accumulated Prediction Sensitivity2022.03 | 0.206 | 0.013 | |
| CFDescription=Counter-factual Fairness2022.03 | 0.326 | 0.025 | |
| P4v selection=gendered words, Base Method=Accumulated Prediction Sensitivity2022.03 | 0.34 | 0.037 | |
| P5v selection=gendered words and embedding vectors, Base Method=Accumulated Prediction Sensitivity2022.03 | 0.363 | 0.098 | |
| P2v selection=PSM, Base Method=Accumulated Prediction Sensitivity2022.03 | 0.397 | 0.102 | |
| P3v selection=PSM and embedding vectors, Base Method=Accumulated Prediction Sensitivity2022.03 | 0.441 | 0.105 |