Synthetic Data
Benchmarks
TaskDatasetSOTA resultTrendResults
5-class synthetic data Example 1 Hard Bin r* ≤ 0.5
93.4Coverage
97
5-class synthetic data Example 1 Marginal
92.3Coverage
97
5-class Synthetic Data Example 2 covariate shift a=0.5 Marginal
92Coverage
75
Synthetic data L = 110
0.175Levenshtein Distance
72
Synthetic data d=100
0.006Runtime (ms)
72
Synthetic Data
0Runtime
57
Synthetic Data
0.176Averaged MSE
54
5-class synthetic data (Example 1) Easy Bin (r* > 0.5) 1.0 (test)
99.7Coverage
52
5-class synthetic data Example 1, Easy Bin r* > 0.5
99.7Coverage
45
Synthetic Data 5 systems
0.24RMSE
39
Synthetic data
0.04Cost (5 Systems, mins)
39
Synthetic Data I
0.023ED
35
Synthetic data 100 seeds (test)
99.017Coverage
32
5-class synthetic data Easy Bin, r* > 0.5
99.7Coverage
30
5-class synthetic data Hard Bin, r* <= 0.5
92.8Coverage
30
5-class synthetic data Marginal
92.3Coverage
30
synthetic data 5-class Example 2 covariate shift a=0.5 Easy Bin (r* > 0.5)
96.6Coverage
30
5-class synthetic data Example 2 covariate shift a=0.5 Hard Bin (r* <= 0.5)
85.6Coverage
30
Synthetic Data (Tucker)
10.7Completeness Ratio (CR)
30
Synthetic data d=10
0.005Runtime (ms)
29
Synthetic Data |V|=5
0.21NSHD
24
Synthetic Data (test)
92.29Task Accuracy
24
Synthetic Data Interact Mode (test)
108.04Reconstruction Accuracy
20
Synthetic Data
2.23Aggregate Disparity (Delta_sum,r)
20
Synthetic data (test)
0.61Chamfer Distance (CD)
19