OpenML
Benchmarks
TaskDatasetSOTA resultTrendResults
OpenML 67 datasets CC18 (10-fold cross-validation average)
71F1 Score
42
OpenML 11 multiclass (test)
44.1MacroF1 (Min)
42
OpenML-cc18
4.99Average Rank (AUC, Acc, F1)
33
OpenML 253 (test)
81.8Accuracy (w/o shift)
28
Openml_586
0.1111-RAE
24
OpenML 11 (various)
46.8Min Accuracy
21
OpenML 618 (5-fold cross-validation)
0.0521-RAE
16
OpenML 586 (5-fold cross-validation)
0.1111-RAE
16
5 OpenML (train)
76.7Balanced Accuracy
13
OpenML MCAR, Missing Probability 0.4 (test)
0MAD
13
OpenML 22 datasets
3.61Rank
12
OpenML CC18
87.8Mean Accuracy
12
OpenML general-purpose (test)
0Violation Exceedance Count
12
OpenML 361249
96.4Coverage
12
OpenML 361247
98Coverage
12
OpenML 361243
97.9Coverage
12
OpenML 361235
97.2Coverage
12
OpenML 72 datasets CC18 (5-fold CV)
76.2Decision Accuracy
11
OpenML datasets
0.881NDCG@1
9
OpenML ST=0.9 (unseen datasets)
79.73Hit@1
9
OpenML ST=0.8 (unseen datasets)
85.81Hit@1
9
OpenML 620
0.4251-RAE
9
OpenML 618
0.3721-RAE
9
OpenML 616
0.3851-RAE
9
OpenML 607
0.3761-RAE
9