Simulated datasets
Benchmarks
TaskDatasetSOTA resultTrendResults
Simulated datasets m=1000, n=1000
0.028Runtime (s) Median
15
Simulated datasets n=500, m=500
0.013Median Runtime (s)
15
Simulated datasets
2.32Avg Brier (Type 1)
6
Simulated datasets n=5,000, Shut Down Date: 2020-01-01
5.6Avg Brier Score (Failure Type 1)
3
Simulated datasets n=10,000 2018-01-01
1.87Avg Brier Score (Type 1)
3
50 simulated datasets (T=20)
3.54Mean Regret
2
50 simulated datasets T=10
0.697Mean Regret
2
50 simulated datasets T=2
0.079Mean Regret
2