Synthetic
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Synthetic 75 HDR images (test)
0.036MSE
4
Synthetic (d=50) 1.0 (train)
5.5Mean Convergence Time (s)
4
Synthetic Scenario 4 - Stereo MF 1.0 (test)
0.19MAE X (m/s)
3
Synthetic Scenario 3 - Multi-Frame 1.0 (test)
0.16MAE X (m/s)
3
Synthetic 50 datasets
56.5F1@0.5
3
Synthetic Novel view
23.63PSNR
3
Synthetic (train)
29.07PSNR
3
Synthetic 500M non-zeros
15.4Running Time (min/iter)
3
Synthetic 250M non-zeros
11.5Running Time (min/iter)
3
Synthetic (n=1.4x10^5, D=5, B=10, m0=7, m1=16) - 100Mbps WAN
400Training Time (s)
3
Synthetic LAN (n=1.4x10^5, D=5, B=10, m0=7, m1=16)
114Training Time (s)
3
Synthetic LAN (n=5x10^4, D=4, B=8, m0=8, m1=7)
39Training Time (s)
3
Synthetic 2 50000 samples, 8000 context, 32 features, 10 balanced classes
88.32Accuracy
3
Synthetic 1 10000 samples 2000 context 100 features 5 balanced classes
87.05Accuracy
3
Synthetic (3e^-x0 + 2 sin x1 + 1/2 x2^2)
0.999R^2
3
Synthetic
89.45Accuracy
3
Synthetic Gauss distribution
2.59Relative Error (No Attacker)
3
Synthetic Zipf distribution
0.12Relative Error (w/o attacker)
3
Synthetic Unif distribution
2.53Relative Error (w/o Attacker)
3
Synthetic Gauss distribution
2.08Relative Error (No Attack)
3
Synthetic Zipf distribution
1.56Relative Error (w/o Attacker)
3
Synthetic Unif distribution
1.49Relative Error (w/o attacker)
3
Synthetic 500 events
13,807Total Bits
3
Synthetic standard (test)
34.14PSNR
3
Synthetic
76.54PSNR
3