Bias-in-Bios
Benchmarks
TaskDatasetSOTA resultTrendResults
Bias in Bios
94.72Accuracy
40
Bias-in-Bios (BiB) balanced (test)
96.9Profession Accuracy
24
Bias-in-Bios
73.4Accuracy (Overall)
18
Bias-in-Bios
36.5Runtime (s)
12
Bias-in-Bios
0.973MCC
12
Bias-in-Bios
3.62Mismatch Rate |M-F|
6
Bias-in-Bios prompts (83 occupations)
1.48Mismatch Rate (M-F)
6
Bias in Bios (test)
0.206Correlation
6
Bias-in-Bios
0.6Kendall's tau (Compression)
6