RELBENCH
Benchmarks
TaskDatasetSOTA resultTrendResults
RelBench rel-avito user-visits
67.9AUC
49
RelBench v1.0 (test)
18.4CTR (Avito Ad)
45
RelBench rel-stack user-badge
89AUC
40
RelBench V1
0.031Avito CTR Error (MAE)
26
RelBench 1.0 (test)
72.03Relational Amazon User Churn
26
RELBENCH rel-amazon item-churn (test)
83.37AUROC
23
RELBENCH rel-avito user-clicks (test)
71.31AUROC
22
RelBench v2 (test)
6.021MAE (RateBeer User-Count)
21
RelBench rel-stack user-engage
90.6AUC
21
Relbench v1
68.36Avito Click AUROC
20
RELBENCH rel-f1 driver-top3 (test)
91.4AUROC
19
RELBENCH rel-f1 driver-dnf (test)
0.812AUROC
19
RELBENCH rel-avito user-visits (test)
0.67AUROC
19
RELBENCH rel-stack user-badge (test)
0.9AUROC
18
RELBENCH rel-hm (test)
0.052MAE
16
RELBENCH rel-f1 (test)
3.539MAE
16
RELBENCH rel-event (test)
0.242MAE
16
RELBENCH rel-avito (test)
0.036MAE
16
RELBENCH rel-amazon (test)
14.087MAE
16
RelBench rel-avito user-clicks
69.04AUC
12
RelBench V1
82.41DNF Score
11
RELBENCH rel-trial (val)
0.36MAE
10
RELBENCH rel-trial (val)
45.395MAE
10
RELBENCH rel-f1 (val)
3.05MAE
10
RELBENCH rel-event (test)
0.855AUROC
10