Entity Regression on RelBench v1.0 (test)
18.4CTR (Avito Ad)Rel GT
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Rel GTpre-trainability=Cannot be pretrained, pretrained=No2025.10 | 18.4 | 3.4 | 17.5 | 22.6 | 13.1 | 28.8 | 17 | — | — | 12.4 | 9.4 | — | — | — | — | — | |
| RDL GNNpre-trainability=Cannot be pretrained, pretrained=No2025.10 | 18.3 | 3.7 | 21.9 | 21.8 | 17.9 | 4 | 18.8 | — | — | 7.6 | 14.3 | — | — | — | — | — | |
| Rel GNNpre-trainability=Cannot be pretrained, pretrained=No2025.10 | 15.6 | 3.5 | 17.9 | 22.1 | 12.2 | 9.5 | 19.7 | — | — | 20.7 | 12.8 | — | — | — | — | — | |
| Griffinpre-trainability=Can be pretrained, pretrained=Yes2025.10 | 8.4 | 25.2 | 32.9 | 30.4 | 42.7 | 2.4 | 18.2 | — | — | 0.6 | 19.5 | — | — | — | — | — | |
| Griffinpre-trainability=Can be pretrained, pretrained=No2025.10 | 5.9 | 23.4 | 30.7 | 31.1 | 41.8 | 6.8 | 11.2 | — | — | 29.9 | 22.6 | — | — | — | — | — | |
| RTzeroCategory=FOUNDATIONAL2026.04 | 5.8 | 57.996 | 18.802 | 8.9 | 11 | 45.5 | 73.999 | 1.24 | — | — | — | 2.901 | 0.379 | 14 | — | — | |
| RTzeroCategory=Zero-shot Foundational2026.05 | 5.8 | — | — | 57.996 | 11 | — | 73.999 | 1.24 | — | — | — | 2.901 | 0.379 | 14.89 | 45.5 | 18.802 | |
| GriffinCategory=FOUNDATIONAL2026.04 | 5 | 53.214 | 35.59 | 15.1 | 9.2 | 46.3 | 78.232 | 1.471 | — | — | — | 4.46 | 0.461 | 15.44 | — | — | |
| GriffinCategory=Zero-shot Foundational2026.05 | 5 | — | — | 53.214 | 9.2 | — | 78.232 | 1.471 | — | — | — | 4.46 | 0.461 | 16.44 | 46.3 | 35.59 | |
| HGTPECategory=SUP. RELATIONALML2026.04 | 4.8 | 55.849 | 15.864 | 6.4 | 6.8 | 44 | 42.648 | 0.992 | — | — | — | 4.392 | 0.261 | 10 | — | — | |
| HGTPECategory=Sup. Relational2026.05 | 4.8 | — | — | 55.849 | 6.8 | — | 42.648 | 0.992 | — | — | — | 4.392 | 0.261 | 10.83 | 44 | 15.864 | |
| Entity MedianCategory=BASE2026.04 | 4.6 | 66.436 | 17.423 | 7.8 | 6.9 | 44.1 | 57.93 | 1.19 | — | — | — | 8.519 | 0.269 | 14 | — | — | |
| HGTCategory=SUP. RELATIONALML2026.04 | 4.6 | 55.868 | 15.412 | 6.4 | 6.8 | 44.3 | 45.169 | 0.988 | — | — | — | 4.226 | 0.264 | 10.44 | — | — | |
| Entity MedianCategory=Baseline2026.05 | 4.6 | — | — | 66.436 | 6.9 | — | 57.93 | 1.19 | — | — | — | 8.519 | 0.269 | 15.06 | 44.1 | 17.423 | |
| HGTCategory=Sup. Relational2026.05 | 4.6 | — | — | 55.868 | 6.8 | — | 45.169 | 0.988 | — | — | — | 4.226 | 0.264 | 11.61 | 44.3 | 15.412 | |
| RTpre-trainability=Can be pretrained, pretrained=Yes2025.10 | 4.5 | 36.8 | 47.4 | 39 | 36.5 | 6.4 | 43.4 | — | — | 51.6 | 33.2 | — | — | — | — | — | |
| DS+AutoGluon*Category=SUP. TABML2026.04 | 4.5 | 45.39 | 14.399 | 4.3 | 6.8 | 43 | 44.706 | 0.918 | — | — | — | 4.251 | 0.256 | 7.11 | — | — | |
| DS+AutoGluonCategory=Sup. Tabular2026.05 | 4.5 | — | — | 45.39 | 6.8 | — | 44.706 | 0.918 | — | — | — | 4.251 | 0.256 | 8.39 | 43 | 14.399 | |
| DS+LightGBMCategory=SUP. TABML2026.04 | 4.4 | 41.122 | 13.928 | 3.6 | 6.5 | 40.7 | 40.581 | 0.879 | — | — | — | 3.963 | 0.284 | 5.11 | — | — | |
| DS+TabPFN-2.5*Category=SUP. TABML2026.04 | 4.4 | 47.908 | 15.631 | 5.9 | 8 | 43.2 | 47.168 | 1.009 | — | — | — | 4.373 | 0.318 | 10.11 | — | — | |
| TabPFN-2.5*Category=FOUNDATIONAL2026.04 | 4.4 | 60.996 | 17.513 | 9.6 | 10.4 | 46.9 | 55.187 | 1.258 | — | — | — | 4.446 | 0.527 | 14.78 | — | — | |
| DS+LightGBMCategory=Sup. Tabular2026.05 | 4.4 | — | — | 41.122 | 6.5 | — | 40.581 | 0.879 | — | — | — | 3.963 | 0.284 | 5.56 | 40.7 | 13.928 | |
| DS+TabPFN-2.5Category=Sup. Tabular2026.05 | 4.4 | — | — | 47.908 | 8 | — | 47.168 | 1.009 | — | — | — | 4.373 | 0.318 | 11.11 | 43.2 | 15.631 | |
| TabPFN-2.5Category=Zero-shot Foundational2026.05 | 4.4 | — | — | 60.996 | 10.4 | — | 55.187 | 1.258 | — | — | — | 4.446 | 0.527 | 15.78 | 46.9 | 17.513 | |
| Global MedianCategory=BASE2026.04 | 4.3 | 64.234 | 16.783 | 7.6 | 6.8 | 46.2 | 57.533 | 1.062 | — | — | — | 4.399 | 0.264 | 12.78 | — | — | |
| Global MedianCategory=Baseline2026.05 | 4.3 | — | — | 64.234 | 6.8 | — | 57.533 | 1.062 | — | — | — | 4.399 | 0.264 | 13.22 | 46.2 | 16.783 | |
| LightGBMCategory=SUP. TABML2026.04 | 4.1 | 60.569 | 16.783 | 7.6 | 6.8 | 42.5 | 44.011 | 1 | — | — | — | 4.17 | 0.264 | 10.22 | — | — | |
| GraphSAGECategory=SUP. RELATIONALML2026.04 | 4.1 | 50.053 | 14.313 | 5.6 | 6.5 | 40 | 44.473 | 0.918 | — | — | — | 4.022 | 0.258 | 6.33 | — | — | |
| LightGBMCategory=Sup. Tabular2026.05 | 4.1 | — | — | 60.569 | 6.8 | — | 44.011 | 1 | — | — | — | 4.17 | 0.264 | 10.61 | 42.5 | 16.783 | |
| GraphSAGECategory=Sup. Relational2026.05 | 4.1 | — | — | 50.053 | 6.5 | — | 44.473 | 0.918 | — | — | — | 4.022 | 0.258 | 7.17 | 40 | 14.313 | |
| RelGNNCategory=SUP. RELATIONALML2026.04 | 3.7 | 48.767 | 14.23 | 5.4 | 6.5 | 30.1 | 44.461 | 0.861 | — | — | — | 3.798 | 0.238 | 4.44 | — | — | |
| RelGNNCategory=Sup. Relational2026.05 | 3.7 | — | — | 48.767 | 6.5 | — | 44.461 | 0.861 | — | — | — | 3.798 | 0.238 | 4.94 | 30.1 | 14.23 | |
| KumoRFMtype=ICL model2026.02 | 3.5 | 55.254 | 16.161 | 4 | 6.5 | 41.7 | 58.231 | 1.088 | — | — | — | — | — | — | — | — | |
| RelGTtype=Supervised2026.02 | 3.5 | 48.922 | 14.267 | 5.4 | 6.5 | 32.6 | 43.992 | 1 | — | — | — | — | — | — | — | — | |
| RelGTCategory=SUP. RELATIONALML2026.04 | 3.5 | 48.922 | 14.267 | 5.4 | 6.5 | 32.6 | 43.992 | 0.869 | — | — | — | 3.917 | 0.25 | 4.67 | — | — | |
| KumoRFM-1Category=FOUNDATIONAL2026.04 | 3.5 | 55.254 | 16.161 | 4 | 6.5 | 41.7 | 58.231 | 0.908 | — | — | — | 2.747 | 0.264 | 7.22 | — | — | |
| RelGTCategory=Sup. Relational2026.05 | 3.5 | — | — | 48.922 | 6.5 | — | 43.992 | 0.869 | — | — | — | 3.917 | 0.25 | 5.33 | 32.6 | 14.267 | |
| KumoRFM-v1Category=Zero-shot Foundational2026.05 | 3.5 | — | — | 55.254 | 6.5 | — | 58.231 | 0.908 | — | — | — | 2.747 | 0.264 | 7.78 | 41.7 | 16.161 | |
| RDBLearntype=ICL model, fine-tuning=none2026.02 | 3.4 | 48.559 | 14.54 | 6.4 | 6.6 | 42.4 | 43.913 | 1.074 | — | — | — | — | — | — | — | — | |
| RDBLearnCategory=FOUNDATIONAL2026.04 | 3.4 | 48.559 | 14.54 | 6.4 | 6.8 | 42.4 | 43.913 | 0.906 | — | — | — | 3.834 | 0.237 | 5.89 | — | — | |
| KumoRFM-2Category=FOUNDATIONAL2026.04 | 3.4 | 46.992 | 13.921 | 3.4 | 6.4 | 43.3 | 43.293 | 0.822 | — | — | — | 2.854 | 0.235 | 2.67 | — | — | |
| RDBLearnCategory=Zero-shot Foundational2026.05 | 3.4 | — | — | 48.559 | 6.8 | — | 43.913 | 0.906 | — | — | — | 3.834 | 0.237 | 6.33 | 42.4 | 14.54 | |
| KumoRFM-v2Category=Zero-shot Foundational2026.05 | 3.4 | — | — | 46.992 | 6.4 | — | 43.293 | 0.822 | — | — | — | 2.854 | 0.235 | 3.11 | 43.3 | 13.921 | |
| RELAGENTCategory=Zero-shot Foundational2026.05 | 3.3 | — | — | 41.765 | 6.4 | — | 37.194 | 0.817 | — | — | — | 4.019 | 0.241 | 2.83 | 38.6 | 13.949 | |
| RTpre-trainability=Can be pretrained, pretrained=No2025.10 | 1.5 | 31.5 | 47.9 | 45.7 | 37.1 | 8.8 | 41.3 | — | — | 33.7 | 28.4 | — | — | — | — | — |