RELBENCH
Benchmarks
TaskDatasetSOTA resultTrendResults
RELBENCH rel-amazon (val)
44.167MAE
8
RELBENCH rel-amazon (val)
11.773MAE
8
RELBench v1.0 (test)
3.84User Ad Visits
7
RelBench rel-hm 12 (test)
69.97AUC
7
RelBench rel-stack 12 (test)
90.44AUC
7
RelBench rel-stack 12 (test)
90.86AUC
7
RelBench rel-amazon 12 (test)
82.97AUC
7
RelBench rel-amazon 12 (test)
70.5AUC
7
RelBench rel-trial 12 (test)
72.54AUC
7
RelBench rel-event 12 (test)
0.878AUC
7
RelBench rel-event 12 (test)
0.836AUC
7
RelBench rel-avito 12 (test)
0.67AUC
7
RelBench rel-avito 12 (test)
68.44AUC
7
RelBench rel-f1 12 (test)
0.841AUC
7
RelBench rel-f1 12 (test)
76.08AUC
7
RelBench rel-stack (test)
0.065MAE
7
RelBench rel-trial (test)
0.349MAE
7
RelBench rel-trial (test)
42.57MAE
7
RELBENCH rel-trial study-outcome (test)
71.04AUROC
6
RELBENCH rel-stack (user-engagement) (test)
0.912AUROC
6
RELBENCH rel-hm user-churn (test)
0.706AUROC
6
RELBENCH rel-amazon user-churn (test)
0.719AUROC
6
RelBench v1.0 (test)
82.4F1 Score (DNF)
5
RelBench rel-trial v1 (val)
71.5AUC (st-outc)
5
RelBench rel-stack v1 (val)
89.6u-engage AUC
5