IHDP
Benchmarks
TaskDatasetSOTA resultTrendResults
IHDP connected regime
1.57PEHE
72
IHDP connected regime
1.57PEHE
72
IHDP (within-sample)
0.31Sqrt PEHE
69
IHDP (out-of-sample)
0.33sqrt(PEHE)
65
IHDP 100 train test splits (out-sample)
1.71ERout
53
IHDP disconnected regime (m1 = 0) (test)
2.11PEHE
40
IHDP
1.392PEHE Mean
27
IHDP
-2.19Bias
24
IHDP (Out-sample)
0.45PEHE
22
IHDP (In-sample)
0.41PEHE
22
IHDP
0.077MSE
20
IHDP in-sample
0.96RMSE
19
IHDP Setup D (out-of-sample)
0.2Normalized RMSE
17
IHDP Setup D (in-sample)
0.2Normalized RMSE
17
IHDP Setup C (out-of-sample)
0.29Normalized RMSE
17
IHDP Setup C (in-sample)
0.268NRMSE
17
IHDP100 a=1 (out-sample)
0.021W2 Score
16
IHDP100 a=0 (out-sample)
0.034W2
16
IHDP
0.076Joint Bias (JB)
14
IHDP semi-synthetic benchmark CEVAE preprocessing (replications 1-5)
0.562sqrt(PEHE)
12
IHDP
0.239d_TV (Total Variation Distance)
12
IHDP (out-of-sample)
1.18RMSE
11
IHDP U -> X (test)
53.4Mean Absolute ATE Prop Error
11
IHDP (sub-sampled)
96Coverage
9
IHDP 40 confounded datasets with no true instrument candidate
0.566Mean Abs ATE Prop Error
9