IHDP
Benchmarks
TaskDatasetSOTA resultTrendResults
IHDP 1000 realizations from NPCI package (heldout)
0.2MAE
9
IHDP 1000 realizations from NPCI package (train val)
0.14MAE
9
IHDP (out-of-sample)
0.4Wasserstein Distance
8
IHDP (in-sample)
0.3Wasserstein Distance
8
IHDP-100 Setup D (out-of-sample)
1.392RMSE
8
IHDP-100 Setup D (in-sample)
1.394RMSE
8
IHDP 10 NPCI replicates
6.519FE / instance
7
IHDP (test)
3.491APIW
7
IHDP out-sample 100 splits (test)
0.308rCRPS
7
IHDP in-sample 100 splits (train)
0.303rCRPS
7
IHDP out-sample 100 splits (test)
0.292rCRPS
7
IHDP in-sample 100 splits (train)
0.281rCRPS
7
IHDP
0.03Running Time (s)
7
IHDP
468.19Memory Consumption (MB)
7
IHDP
15.93APIW
6
IHDP Data
3.325ATE
6
IHDP-100
98.1AUC
5
IHDP
0.06MAE
5
IHDP 1000 realizations from NPCI package (all data)
0.11MAE
4
IHDP Scenario VI Hill (test)
4TPR
4
IHDP Scenario V Hill (test)
1True Positive Rate
4
IHDP Scenario IV Hill (test)
53True Positive Rate
4
IHDP Scenario III Hill (test)
0.34TPR
4
IHDP Scenario II Hill (test)
100TPR
4
IHDP target sample modified simulation replications
0.18ATE1
3