CATE Estimation on Claims dataset (test)
0.48Rate @ 0.999CaML (ours)
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CaML (ours)mode=zero-shot, meta-learning=true, RA-learner=true2023.01 | 0.48 | 0.38 | 0.23 | 0.13 | 0.18 | 0.27 | 0.38 | 0.45 | 0.54 | 0.43 | 0.26 | 0.16 | |
| RA-learnermode=trained on test interventions2023.01 | 0.47 | 0.37 | 0.23 | 0.14 | 0.17 | 0.26 | 0.38 | 0.45 | 0.54 | 0.42 | 0.26 | 0.16 | |
| CaML w/o RA-learnermode=zero-shot, meta-learning=true, RA-learner=false2023.01 | 0.45 | 0.36 | 0.22 | 0.14 | 0.16 | 0.24 | 0.34 | 0.41 | 0.48 | 0.38 | 0.26 | 0.16 | |
| T-learner w/ meta-learningmode=zero-shot, meta-learning=true2023.01 | 0.4 | 0.31 | 0.18 | 0.11 | 0.15 | 0.22 | 0.32 | 0.38 | 0.45 | 0.35 | 0.21 | 0.13 | |
| CaML - w/o meta-learningmode=zero-shot, meta-learning=false, RA-learner=true2023.01 | 0.39 | 0.31 | 0.18 | 0.11 | 0.15 | 0.22 | 0.32 | 0.39 | 0.45 | 0.35 | 0.22 | 0.14 | |
| T-learnermode=trained on test interventions2023.01 | 0.32 | 0.26 | 0.16 | 0.1 | 0.12 | 0.18 | 0.26 | 0.31 | 0.36 | 0.29 | 0.18 | 0.11 | |
| S-learner w/ meta-learningmode=zero-shot, meta-learning=true2023.01 | 0.21 | 0.16 | 0.09 | 0.05 | 0.08 | 0.11 | 0.15 | 0.16 | 0.25 | 0.18 | 0.1 | 0.06 | |
| R-learnermode=trained on test interventions2023.01 | 0.19 | 0.17 | 0.12 | 0.08 | 0.06 | 0.1 | 0.19 | 0.26 | 0.24 | 0.21 | 0.15 | 0.11 | |
| GraphITEmode=trained on test interventions2023.01 | 0.19 | 0.12 | 0.05 | 0.03 | 0.07 | 0.08 | 0.09 | 0.1 | 0.23 | 0.14 | 0.07 | 0.04 | |
| TARNetmode=trained on test interventions2023.01 | 0.15 | 0.12 | 0.07 | 0.05 | 0.05 | 0.08 | 0.12 | 0.14 | 0.18 | 0.15 | 0.09 | 0.06 | |
| FlexTENetmode=trained on test interventions2023.01 | 0.1 | 0.09 | 0.06 | 0.04 | 0.04 | 0.06 | 0.11 | 0.16 | 0.15 | 0.13 | 0.09 | 0.06 | |
| DragonNetmode=trained on test interventions2023.01 | 0.09 | 0.07 | 0.05 | 0.04 | 0.03 | 0.05 | 0.08 | 0.11 | 0.15 | 0.12 | 0.08 | 0.06 | |
| X-learnermode=trained on test interventions2023.01 | 0.06 | 0.05 | 0.04 | 0.03 | 0.02 | 0.04 | 0.08 | 0.12 | 0.09 | 0.07 | 0.06 | 0.05 | |
| Randomtraining=random baseline2023.01 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| SINmode=trained on test interventions2023.01 | 0 | 0 | 0 | 0 | 0 | 0 | 0.01 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 |