Simulated data
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Simulated Data
90ROC AUC
70
Simulated data (d=100, s=5)
160Minimum Tasks (T)
41
Simulated data
0.156Calibration Error
18
Simulated Data Dense Weights
16.09Mean run time (seconds)
15
Simulated data
90.3Cosine Similarity
12
Simulated Data FairPCA
0.057Average Runtime (s)
12
Simulated data 10 scenes (test)
39.8PSNR
10
Simulated data N = 5000 (test)
74.63AUC
6
Simulated data N = 2000 (test)
75AUC
6
Simulated data warpMix-mu3
0.003Estimation Error
6
Simulated data warpMix-mu2
0.007Estimation Error
6
Simulated data warpMix-mu1
0.015Estimation Error
6
Simulated data PM2-F
0.054Estimation Error
6
Simulated data PM1-F
0.045Estimation Error
6
Simulated Data p=300 (test)
0.181MSE
5
Simulated Data p=100 (test)
0.193MSE
5
Simulated Data (p=50) (test)
0.167MSE
5
Simulated Data Heterogeneous non-nested shards poor separability
2.17Mean Running Time (s)
4
Simulated Data Heterogeneous non-nested shards easy separability
1.8Mean Running Time (s)
4
Simulated Data Heterogeneous nested shards poor separability
2.29Mean Running Time (s)
4
Simulated Data Heterogeneous nested shards easy separability
1.82Mean Running Time (s)
4
Simulated Data Homogeneous shards poor separability
6.62Mean Running Time (s)
4
Simulated Data Homogeneous shards easy separability
7Mean Running Time (s)
4
Simulated Data Setting D: 4 x 4 x 3 (test)
0.742Revenue (rev)
4
Simulated Data Setting C: 4 x 4 x 2 (test)
74.1Revenue
4