Synthetic
Benchmarks
TaskDatasetSOTA resultTrendResults
Synthetic homo ratio 0.8
99.89Accuracy
21
Synthetic homo ratio 0.5
92.69Accuracy
21
Synthetic Set Size m=n=2^{12}, Dimension d=3
246.1Communication Cost (MB)
20
Synthetic Set Size m=n=2^{12}, Dimension d=2
127.8Communication Cost (MB)
20
Synthetic Set Size m=n=2^8, Dimension d=4
29Communication Cost (MB)
20
Synthetic Set Size m=n=2^8, Dimension d=3
17.37Communication Cost (MB)
20
Synthetic Set Size m=n=2^8, Dimension d=2
10.03Communication Cost (MB)
20
SYNTHETIC-A
0.509Cost
20
Synthetic Image m=3 (test)
0.095Theta Error
18
Synthetic
4.95Average IGDoffline Rank
18
Synthetic d=20 (test)
2.44MAE (10^-2)
18
Synthetic d=20 (test)
0.103MAE (10^-2)
18
Synthetic d=40 1.0 (test)
2.59MAE
18
Synthetic d=40 1.0 (test)
12.56MAE
18
Synthetic
97.3Success Rate
18
Synthetic (synthetic)
64P50 TTFT (ms)
18
Synthetic 15 images (test)
56PSNR (ME)
18
Synthetic Set Size m=n=2^{12}, Dimension d=4
431.3Communication Cost (MB)
17
synthetic
92.68AMI
17
synthetic
0.955ARI
17
Synthetic Set Size m=n=2^{16}, Dimension d=2
2,032Communication Cost (MB)
16
Synthetic 20 variables, 5 latent
82Skeleton F1 Score
16
Synthetic Non-linear misspecification
71F1 Score
16
Synthetic Non-gaussian misspecification
79F1 Score
16
Synthetic (out)
3.06PEHE
16