Binary Classification on Relbench v1
68.36Avito Click AUROCRelAgent
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| RelAgentModel Category=Supervised2026.07 | 68.36 | 67.79 | 71.86 | 70.78 | 82.84 | 90.41 | 88.42 | 71.07 | 76.44 | 2.62 | |
| RelGTModel Category=Supervised2026.07 | 68.3 | 66.78 | 68.61 | 70.39 | 82.55 | 90.53 | 86.32 | 69.27 | 75.34 | 4.81 | |
| RelGNNModel Category=Supervised2026.07 | 68.23 | 66.18 | 71.24 | 70.99 | 82.64 | 90.75 | 88.98 | 70.93 | 76.24 | 3.12 | |
| RDBLearn (v1.1)Model Category=Foundation model, Source Access=Open-Source2026.07 | 67.55 | 66 | 72.71 | 68.81 | 82.25 | 89.98 | 84.62 | 68.22 | 75.02 | 6 | |
| KumoRFM-2 (orig.)Model Category=Foundation model, Source Access=Closed-Source, Implementation Variant=original2026.07 | 67.42 | 69.41 | 72.03 | 69.1 | 82.17 | 89.4 | 87.15 | 69.27 | 75.74 | 5 | |
| KumoRFM-2 (repro.)Model Category=Foundation model, Source Access=Closed-Source, Implementation Variant=reproduction2026.07 | 67.42 | 69.41 | 72.03 | 67.71 | 80.18 | 88.69 | 85.4 | 67.81 | 74.83 | 6.06 | |
| TabPFN-RELModel Category=Foundation model, Source Access=Closed-Source2026.07 | 67.09 | 66.68 | 76.43 | 70.27 | 82.81 | 90.66 | 85.17 | 70.55 | 76.21 | 4.06 | |
| GraphSAGEModel Category=Supervised2026.07 | 65.9 | 66.2 | 68.6 | 70.42 | 82.81 | 90.59 | 88.86 | 69.88 | 75.41 | 4.81 | |
| KumoRFM-1Model Category=Foundation model, Source Access=Closed-Source2026.07 | 64.85 | 64.11 | 70.79 | 67.29 | 79.93 | 87.09 | 80 | 67.71 | 72.72 | 9.69 | |
| RDB-PFNModel Category=Foundation model, Source Access=Open-Source2026.07 | 64.46 | 65.82 | 64.5 | 65.92 | 79.59 | 88.04 | 84.52 | 67.21 | 72.51 | 9.75 | |
| OpenRFM (TabPFN)Model Category=Foundation model, Source Access=Closed-Source, Implementation Variant=TabPFN2026.07 | 63.9 | 64.6 | 63.4 | — | — | 88.4 | 86.4 | 68.9 | — | — | |
| OpenRFM (TabICL)Model Category=Foundation model, Source Access=Closed-Source, Implementation Variant=TabICL2026.07 | 62.3 | 64.6 | 60.8 | — | — | 88.5 | 86.3 | 68.6 | — | — | |
| RelLLMModel Category=Foundation model, Source Access=Open-Source2026.07 | 62.28 | 56.17 | 59.02 | 60.07 | 64.1 | 69.46 | 62.12 | 55.95 | 61.15 | 15.5 | |
| RandGNNModel Category=Foundation model, Source Access=Open-Source2026.07 | 61.58 | 64.15 | 55.98 | 65.87 | 77.73 | 85.14 | 83.14 | 66.54 | 70.02 | 11.38 | |
| LLM-BModel Category=Foundation model, Source Access=Open-Source2026.07 | 61.32 | 60.28 | 55.72 | 60.56 | 71.96 | 81.01 | 71.13 | 64.34 | 65.79 | 14.25 | |
| LLM-AModel Category=Foundation model, Source Access=Open-Source2026.07 | 59.8 | 62.7 | 57.4 | 58.1 | 62.1 | 78 | 80 | 59.8 | 64.74 | 14.81 | |
| RTModel Category=Foundation model, Source Access=Open-Source2026.07 | 59.5 | 61.8 | 51.8 | 64 | 70.9 | 75.7 | 80.1 | 62.8 | 65.83 | 14.31 | |
| LightGBMModel Category=Supervised2026.07 | 53.6 | 53.05 | 70.09 | 52.22 | 62.54 | 63.39 | 63.43 | 55.21 | 59.19 | 16.25 | |
| PlurelModel Category=Foundation model, Source Access=Open-Source2026.07 | 47.9 | 63.4 | 51.8 | 65 | 72.5 | 86.2 | 82 | 66 | 66.85 | 12.94 | |
| GriffinModel Category=Foundation model, Source Access=Open-Source2026.07 | 45.9 | 60.7 | 51 | 62.3 | 69 | 77.5 | 73.5 | 60.2 | 62.51 | 15.62 |