Graph Recovery on ALARM
5FPR (α=0.05)CausalSynth
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CausalSynthSetting=Oracle, Discovery Algo=Ground Truth, Samples (N)=10,000, Time (s)=552026.05 | 5 | 0 | 0.91 | |
| CausalSynthSetting=Oracle, Discovery Algo=Ground Truth, Samples (N)=50,000, Time (s)=1102026.05 | 5.1 | 0 | 0.89 | |
| CausalSynthSetting=Oracle, Discovery Algo=Ground Truth, Samples (N)=1,000, Time (s)=242026.05 | 5.3 | 0 | 0.88 | |
| CausalSynthSetting=Learned, Discovery Algo=NOTEARS (Score), Samples (N)=10,000, Time (s)=18572026.05 | 5.8 | 4 | 0.78 | |
| CausalSynthSetting=Learned, Discovery Algo=GES (Score), Samples (N)=10,000, Time (s)=4152026.05 | 6.1 | 5 | 0.72 | |
| CausalSynthSetting=Learned, Discovery Algo=PC (Constraint), Samples (N)=10,000, Time (s)=3432026.05 | 7.5 | 9 | 0.58 | |
| CausalSynthSetting=Learned, Discovery Algo=PC (Constraint), Samples (N)=1,000, Time (s)=1522026.05 | 8.8 | 12 | 0.45 | |
| GReaTSetting=Baselines, Discovery Algo=GReaT [4], Samples (N)=10,000, Time (s)=1,5642026.05 | 18.2 | — | 0.28 | |
| TabDDPMSetting=Baselines, Discovery Algo=TabDDPM [24], Samples (N)=10,000, Time (s)=4122026.05 | 21.5 | — | 0.21 | |
| GAN (Latent)Setting=Baselines, Discovery Algo=GAN (Latent), Samples (N)=10,000, Time (s)=1182026.05 | 38 | — | 0.03 | |
| VAE (Latent)Setting=Baselines, Discovery Algo=VAE (Latent), Samples (N)=10,000, Time (s)=892026.05 | 42 | — | 0.01 |