ACIC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ACIC 2016 (In-sample)
2.252PEHE
13
ACIC 2016 (out-of-sample)
1.67SQRT(PEHE)
10
ACIC 2016 (in-sample)
1.56sqrt(PEHE)
10
ACIC out-of-sample 2018
0Top-1 % PEHE Error
10
ACIC in-sample 2018
37.5TOP1 % (PEHE sqrt)
10
ACIC 2016
14.29Total Variation (TV)
10
ACIC 18 (out-of-sample)
0.07Root PEHE
9
ACIC18 (in-sample)
0.05Root PEHE
9
ACIC 24 datasets 2018 (out-of-sample)
36.86Best Performance Ratio
9
ACIC 2018 (in-sample)
31.34Percent Best
9
ACIC 77 datasets 2016 (out-of-sample)
25.82% Best
9
ACIC 77 datasets 2016 (in-sample)
26.73Percentage Best
9
ACIC 18 (out-of-sample)
0.12Wasserstein Distance
8
ACIC18 (in-sample)
0.04Wasserstein Distance
8
ACIC16 (out-of-sample)
0.42Wasserstein Distance
8
ACIC16 (in-sample)
0.36Wasserstein Distance
8
ACIC
0.06Runtime (s)
7
ACIC
477.31Memory Consumption (MB)
7
ACIC Challenge outcome 16 (test)
0.35Average W1 Error
6
ACIC Gaussian outcome 2019 (synthetic)
0.05Average W1 Error
6
ACIC 2016
61.82Win Rate (LogProb Improvement)
6
ACIC 2018 (all datasets)
0.35Delta All (Δ_all)
4
High-dimensional ACIC
100Valid Percentage
3
ACIC 2016 (Out-of-sample)
1.53RMSE
3
ACIC 2016 (In-sample)
1.5RMSE
3