Fairness evaluation
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
72.2Score
34
Jul 7, 2026
99.6Score
34
Jul 7, 2026
98.26BBQ Score
24
Jul 1, 2026
90.88CooC Score
18
Jul 7, 2026
-0.13Equal Opportunity
17
Jun 23, 2026
73.5Score
16
Apr 10, 2026
65.8Score
16
Apr 10, 2026
68.3Score
16
Apr 10, 2026
78.48Fairness Mean
16
Feb 26, 2026
-0.058Statistical Parity
15
Mar 6, 2026
53.24PP
14
Mar 12, 2026
4.26PP
14
Mar 12, 2026
0.95PP
14
Mar 12, 2026
5.66PP
14
Mar 12, 2026
31.28EO Gap (0.1%)
11
Jun 4, 2026
0.113COMPAS Gap
10
Jun 1, 2026
11.2Utrecht DP
10
Jun 1, 2026
-0.168Statistical Parity
10
Mar 6, 2026
75.6BiasAUC
9
Feb 26, 2026
51.461SS
9
Feb 26, 2026
65.057Stereotype Score
9
Feb 26, 2026
-0.15Equal Opportunity
8
Jun 23, 2026
-0.13Equal Opportunity (EO)
8
Jun 23, 2026
0.8CDR (Race)
8
Feb 26, 2026
1.82PP
7
Mar 12, 2026