Synthetic
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Synthetic Square shift
4.27Average Error (%)
6
Synthetic Linear shift
4.7Average Error
6
Synthetic sequences (test)
47.45PSNR
6
SYNTHETIC-NEW (test)
95.96Accuracy
6
Synthetic (d=20) 1.0 (train)
2.1Mean Convergence Time (s)
6
Synthetic d=10 1.0 (train)
0.6Mean Convergence Time (s)
6
Synthetic (test)
98.5Accuracy (Glare)
5
Synthetic
96.14AUC
5
Synthetic 500 features (test)
1.39Inference Time (s)
5
Synthetic simulator (test)
37.73Mean Return
5
Synthetic
0.35MAE
5
Synthetic 2
25Iterations
5
Synthetic 1
19Iterations
5
Synthetic 2
114Iterations
5
Synthetic 1
24Iterations
5
Synthetic 2
57Iterations
5
Synthetic
32.76Decode tok/s
5
Synthetic Downstream Gradual Shift (test)
97.76Coverage
5
Synthetic Upstream Gradual Shift
92.3Coverage
5
Synthetic p=q=500, M=10, High noise
0.08MSE_W
5
Synthetic p=q=500, M=10, Low noise
0.01MSE (W)
5
Synthetic 1k tokens generation (inference)
2,626Throughput (k tokens/s)
5
Synthetic evaluation set
72.3Pt-F1
5
Synthetic Gauss distribution
1.28Relative Error (w/o attacker)
5
Synthetic Zipf distribution
1.09Relative Error (w/o attacker)
5