Entity Regression on RelBench V1
0.031Avito CTR Error (MAE)TabPFN-REL
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TabPFN-REL2026.05 | 0.031 | 3.757 | 0.241 | 40.202 | 0.385 | 14.359 | 46.199 | 0.068 | 0.059 | 0.864 | 3.56 | — | |
| TabPFN-RELModel Category=Foundation Model, Source=Closed-Source2026.07 | 0.031 | — | — | 40.202 | 0.385 | 14.359 | 46.199 | 0.068 | 0.059 | — | 4.86 | 14.472 | |
| KumoRFMv2evaluation_protocol=reevaluated by authors using evaluation scripts2026.05 | 0.033 | 4.022 | 0.241 | 41.974 | 0.433 | 14.627 | 45.352 | 0.065 | 0.043 | 0.866 | 4.33 | — | |
| RelAgentModel Category=Supervised2026.07 | 0.033 | — | — | 37.194 | 0.386 | 13.949 | 41.765 | 0.064 | 0.035 | — | 2.21 | 13.347 | |
| KumoRFM-2 (repro.)*Model Category=Foundation Model, Source=Closed-Source2026.07 | 0.033 | — | — | 41.974 | 0.433 | 14.627 | 45.352 | 0.065 | 0.043 | — | 4.93 | 14.647 | |
| RDBLearn (v1.1)Model Category=Foundation Model, Source=Open-Source2026.07 | 0.033 | — | — | 43.2 | 0.378 | 14.504 | 47.038 | 0.067 | 0.063 | — | 5.57 | 15.04 | |
| RDBLearn2026.05 | 0.034 | 3.834 | 0.237 | 43.913 | 0.424 | 14.54 | 48.559 | 0.068 | 0.064 | 0.906 | 5.11 | — | |
| RDBLearn + v2.52026.05 | 0.034 | 3.93 | 0.243 | 43.409 | 0.429 | 14.463 | 49.053 | 0.068 | 0.066 | 0.913 | 6.28 | — | |
| RDBLearn + v32026.05 | 0.034 | 3.835 | 0.245 | 43.29 | 0.375 | 14.72 | 50.097 | 0.068 | 0.064 | 0.898 | 5.89 | — | |
| KumoRFM-2 (orig.)*Model Category=Foundation Model, Source=Closed-Source2026.07 | 0.034 | — | — | 43.293 | 0.433 | 13.921 | 46.992 | 0.064 | 0.034 | — | 3.86 | 14.967 | |
| RelGT2026.05 | 0.035 | 3.917 | 0.25 | 43.992 | 0.326 | 14.267 | 48.922 | 0.065 | 0.054 | 0.87 | 4.67 | — | |
| KumoRFMv1*evaluation_protocol=potential overestimation due to different protocol2026.05 | 0.035 | 2.747 | 0.264 | 58.231 | 0.417 | 16.161 | 55.254 | 0.065 | 0.04 | 0.908 | 6.06 | — | |
| RelGTModel Category=Supervised2026.07 | 0.035 | — | — | 43.992 | 0.326 | 14.267 | 48.922 | 0.065 | 0.054 | — | 5.14 | 15.38 | |
| KumoRFM-1Model Category=Foundation Model, Source=Closed-Source2026.07 | 0.035 | — | — | 58.231 | 0.417 | 16.161 | 55.254 | 0.065 | 0.04 | — | 7.64 | 18.6 | |
| RelGNN2026.05 | 0.037 | 3.798 | 0.238 | 44.461 | 0.301 | 14.23 | 48.767 | 0.065 | 0.054 | 0.861 | 3.72 | — | |
| RelGNNModel Category=Supervised2026.07 | 0.037 | — | — | 44.461 | 0.301 | 14.23 | 48.767 | 0.065 | 0.054 | — | 5.21 | 15.416 | |
| RandGNNModel Category=Foundation Model, Source=Open-Source2026.07 | 0.038 | — | — | 53.37 | 0.434 | 17.58 | 66.13 | 0.071 | 0.065 | — | 11.43 | 19.67 | |
| GraphSAGE2026.05 | 0.041 | 4.022 | 0.258 | 44.473 | 0.4 | 14.313 | 50.053 | 0.065 | 0.056 | 0.918 | 6.39 | — | |
| LightGBMModel Category=Supervised2026.07 | 0.041 | — | — | 44.011 | 0.425 | 16.783 | 60.569 | 0.068 | 0.076 | — | 9.93 | 17.425 | |
| GraphSAGEModel Category=Supervised2026.07 | 0.041 | — | — | 44.473 | 0.4 | 14.313 | 50.053 | 0.065 | 0.056 | — | 7.21 | 15.629 | |
| Global MedianModel Category=Base2026.07 | 0.043 | — | — | 57.533 | 0.462 | 16.783 | 64.234 | 0.068 | 0.076 | — | 11.71 | 19.886 | |
| Entity MedianModel Category=Base2026.07 | 0.046 | — | — | 57.93 | 0.441 | 17.423 | 66.436 | 0.069 | 0.078 | — | 12.71 | 20.346 | |
| Griffin2026.05 | 0.05 | 4.46 | 0.461 | 78.232 | 0.463 | 35.59 | 53.214 | 0.092 | 0.151 | 1.471 | 10.56 | — | |
| GriffinModel Category=Foundation Model, Source=Open-Source2026.07 | 0.05 | — | — | 78.232 | 0.463 | 35.59 | 53.214 | 0.092 | 0.151 | — | 13.86 | 23.97 | |
| RT*zeroevaluation_protocol=potential overestimation due to different protocol2026.05 | 0.058 | 2.901 | 0.379 | 73.999 | 0.455 | 18.802 | 57.996 | 0.11 | 0.089 | 1.24 | 9.44 | — | |
| RTModel Category=Foundation Model, Source=Open-Source2026.07 | 0.058 | — | — | 73.999 | 0.455 | 18.802 | 57.996 | 0.11 | 0.089 | — | 13.71 | 21.644 |