Synthetic
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Synthetic Avg Standard
0.025MSE
13
Synthetic nD=10000, d=2, dmax=10, 400 nodes
2.2CI Test Count
13
Synthetic nD=10000, d=2, dmax=10, 200 nodes
1.14Number of CI Tests
13
Synthetic nD=10000, d=2, dmax=10, 100 nodes
0.66CI Test Count
13
Synthetic (test)
79.48Mean AUPR (Confounder)
13
Synthetic interaction
52.29AUROC
13
Synthetic newvar
0.523AUROC
13
Synthetic mechanism
68.51AUROC
13
Synthetic confounder
74.88AUROC
13
Synthetic d_phi=2 out-sample
5.64Policy Error Rate (ER_out)
13
Synthetic (d_phi=1) out-sample
8.18Error Rate (ER_out)
13
Synthetic Event-based (irregular) encoding
99.93Accuracy
13
Synthetic Equidistant encoding
100Accuracy
13
Synthetic mixture dx=2
0.87Normalized Log-Likelihood
13
SYNTHETIC
100Accuracy
13
Synthetic (test)
8.3EER
12
Synthetic-IV Blur
24.91RMSE
12
Synthetic-I Translation
25.95RMSE
12
Synthetic Hard
92.9Average Coverage
12
Synthetic Easy
93.6Average Coverage
12
Synthetic Sequence length 256
0.009Original Latency (s)
12
Synthetic
-4.75Log10 Relative Error
12
Synthetic O(5)
0.72Relative MSE (10^-1)
12
Synthetic (test)
94NF (1)
12
Synthetic multi-task
90Accuracy
12