COMPAS
Benchmarks
TaskDatasetSOTA resultTrendResults
COMPAS
100Effectiveness
36
Compas
70.06Accuracy
28
COMPAS (test)
62Accuracy
28
COMPAS (test)
0OOD Ratio
24
COMPAS
72.9Validity
21
COMPAS
66.62Accuracy
21
COMPAS
96Avg Fidelity
19
COMPAS
-0.212Multicalibration Error
16
COMPAS
-0.174DP Disparity
16
COMPAS (test)
69.6Accuracy
16
COMPAS
65.77Accuracy
15
COMPAS
73.8Accuracy
15
COMPAS race (test)
1.8DP
14
COMPAS
31.1Average Expected Loss
14
COMPAS two-year recidivism (test)
0.853AUC
13
compas
78Faithfulness
12
COMPAS
-0.203AOD
12
COMPAS
66.1Accuracy
12
COMPAS
68.2Average Accuracy
12
COMPAS
0.113COMPAS Gap
10
compas
73.11AUC
10
COMPAS
0Latency (mins)
9
COMPAS
100VCR
9
COMPAS Gender 34 (test)
32.6Total Interventions
9
COMPAS Gender
0.8Demographic Parity
9