ACS
Benchmarks
TaskDatasetSOTA resultTrendResults
ACS
1.41WM (Weighted Mean)
28
ACS
564.44Best Objective Value
23
ACS dataset I=[20%, 40%] (test)
0.967pSP Fairness
20
ACS-I (synthetic)
78.19Acc
15
ACS In-domain 8 trained tasks (train)
0.94ACCIA Score
12
ACS California (TravelTime) Folktables 2018
0.61KSComp
10
ACS California (Income) Folktables 2018
0.08KSComp
10
ACS 331
88.2Exact Match Accuracy
9
ACS Realistic
71.9Exact Matching Accuracy
9
ACS
100Accuracy
8
ACS Income
0.513ROC AUC
8
ACS In-distribution 10 axes (test)
97Refusal MC Recall
7
ACS California Employment Folktables 2018
0.96KSComp
5
ACS California Coverage Folktables 2018
0.74KSComp
5
ACS Income (test)
52,666Number of Manipulated Agents
4
ACS South Carolina
13.3Rejection Rate
4
ACS Public Coverage
0.91Latency (minutes)
3
ACS Public Coverage
97.4VCR
3
ACS Public Coverage
99.9Retained
3
ACS Income
80.9Accuracy
2