RELBENCH
Benchmarks
TaskDatasetSOTA resultTrendResults
RELBENCH rel-event user-repeat (test)
79.26AUROC
10
RELBench ad-ctr
0.221MAE
9
RELBench user-attendance
0.23MAE
9
RELBench driver-position
2.13MAE
9
RELBench site-success
0.31MAE
9
RELBench user-visits
70.15ROC-AUC
9
RELBench user-clicks
0.688ROC-AUC
9
RELBench user-ignore
81.25ROC-AUC
9
RELBench user-repeat
82.36ROC-AUC
9
RELBench driver-top3
86.82ROC-AUC
9
RELBench driver-dnf
78.21ROC-AUC
9
RELBench study-outcome
72.35ROC-AUC
9
RELBENCH rel-trial (test)
0.397MAE
9
RELBENCH rel-trial (test)
43.682MAE
9
RELBENCH rel-stack (test)
0.062MAE
9
RELBENCH rel-amazon (test)
48.224MAE
9
Relbench v2
84.7RateBeer Beer Churn Score
8
RelBench rel-trial (test)
5.5R2 Score
8
RelBench rel-trial study-outcome
71.58AUC
8
RelBench rel-hm user-churn
69.27AUC
8
RelBench rel-avito user-churn
0.704AUC
8
RELBENCH rel-stack (val)
0.057MAE
8
RELBENCH rel-hm (val)
0.06MAE
8
RELBENCH rel-event (val)
0.239MAE
8
RELBENCH rel-avito (val)
0.033MAE
8