Binary Classification on RelBench 1.0 (test)
72.03Relational Amazon User ChurnKumoRFM-2
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| KumoRFM-2Method Category=Foundational, Hops=22026.04 | 72.03 | — | 69.27 | 87.15 | 89.4 | 82.17 | 69.41 | 67.42 | 90.83 | 84.59 | — | 79.6 | 92.18 | 81.66 | 3.08 | |
| DS+LightGBMMethod Category=Supervised Tabular ML, Feature Engineering Strategy=Manual (DS+)2026.04 | 72 | — | 69 | 86.2 | 90.3 | 81.8 | 64.46 | 64.27 | 84.23 | 69.8 | — | 75.62 | 82.4 | 75.42 | 7.75 | |
| Rel LLMpre-trainability=Cannot be pretrained, pretrained=Yes2025.10 | 71.9 | — | 70.5 | 89.6 | 91.2 | 83.4 | 67 | 66.7 | 71 | 77.2 | 82.2 | 77.1 | — | — | — | |
| TabPFN-2.5*Method Category=Foundational, Feature Engineering Strategy=None2026.04 | 71.74 | — | 54.99 | 52.26 | 59.66 | 59.3 | 51.45 | 54.44 | 70.91 | 61.21 | — | 61.63 | 77.35 | 69.1 | 16.42 | |
| RDBLearnMethod Category=Foundational, Feature Engineering Strategy=Automatic (DFS+)2026.04 | 71.58 | — | 68.05 | 85.26 | 89.39 | 82.07 | 65.49 | 69.04 | 82.52 | 70.87 | — | 75.97 | 79.69 | 75.04 | 8.08 | |
| RelGNNMethod Category=Supervised Relational ML, Hops=22026.04 | 71.24 | — | 70.93 | 88.98 | 90.75 | 82.64 | 66.18 | 68.23 | 86.18 | 75.29 | — | 78.06 | 85.69 | 79.61 | 3.75 | |
| Rel GNNpre-trainability=Cannot be pretrained, pretrained=No2025.10 | 71 | — | 70.9 | 89 | 90.8 | 82.6 | 66.2 | 68.2 | 71.2 | 75.3 | 85.7 | 77.1 | — | — | — | |
| RTpre-trainability=Can be pretrained, pretrained=Yes2025.10 | 70.8 | — | 70.5 | 88.7 | 90.2 | 83.4 | 65.2 | 59 | 68.2 | 84.2 | 91.9 | 77.2 | — | — | — | |
| KumoRFM-1Method Category=Foundational2026.04 | 70.79 | — | 67.71 | 80 | 87.09 | 79.93 | 64.11 | 64.85 | 89.2 | 82.41 | — | 76.71 | 91.07 | 76.08 | 8.33 | |
| DS+TabPFN-2.5*Method Category=Supervised Tabular ML, Feature Engineering Strategy=Manual (DS+)2026.04 | 70.75 | — | 68.31 | 85.08 | 89.07 | 79.83 | 64.53 | 64.21 | 85.7 | 71.16 | — | 74.92 | 77.7 | 76.43 | 9.5 | |
| RDL GNNpre-trainability=Cannot be pretrained, pretrained=No2025.10 | 70.7 | — | 69.4 | 88.9 | 90.6 | 82.8 | 66.1 | 63.1 | 68.6 | 72.5 | 80.9 | 75.4 | — | — | — | |
| DS+AutoGluon*Method Category=Supervised Tabular ML, Feature Engineering Strategy=Manual (DS+)2026.04 | 70.51 | — | 68.71 | 85.38 | 89.94 | 80.45 | 65.87 | 65.66 | 82.31 | 70.01 | — | 75.36 | 82.53 | 74.85 | 8.5 | |
| RTpre-trainability=Can be pretrained, pretrained=No2025.10 | 70.5 | — | 69.9 | 88.5 | 90 | 83.2 | 65 | 63.6 | 68.6 | 78.7 | 82.7 | 76.1 | — | — | — | |
| Rel GTpre-trainability=Cannot be pretrained, pretrained=No2025.10 | 70.4 | — | 69.3 | 86.3 | 90.5 | 82.5 | 66.8 | 68.3 | 68.6 | 75.9 | 83.5 | 76.2 | — | — | — | |
| LightGBMMethod Category=Supervised Tabular ML, Feature Engineering Strategy=None2026.04 | 70.09 | — | 55.21 | 63.43 | 63.39 | 62.54 | 53.05 | 53.6 | 79.93 | 68.56 | — | 63.67 | 73.92 | 68.04 | 16.75 | |
| Griffinpre-trainability=Can be pretrained, pretrained=No2025.10 | 70 | — | 68.3 | 87 | 89.8 | 81.1 | 65 | 63 | 68.9 | 74.5 | 82.5 | 75 | — | — | — | |
| Griffinpre-trainability=Can be pretrained, pretrained=Yes2025.10 | 69.4 | — | 68 | 87 | 90.4 | 79.9 | 62.6 | 64.7 | 64.6 | 66.7 | 78.7 | 73.2 | — | — | — | |
| RelGTMethod Category=Supervised Relational ML, Hops=22026.04 | 68.61 | — | 69.27 | 86.32 | 90.53 | 82.55 | 66.78 | 68.3 | 81.57 | 75.87 | — | 76.65 | 83.52 | 76.09 | 6 | |
| GraphSAGEMethod Category=Supervised Relational ML, Hops=22026.04 | 68.6 | — | 69.88 | 88.86 | 90.59 | 82.81 | 66.2 | 65.9 | 81.62 | 72.62 | — | 75.83 | 75.54 | 76.89 | 6.42 | |
| HGTPEMethod Category=Supervised Relational ML, Hops=22026.04 | 59.21 | — | 65.69 | 85.66 | 88.17 | 78.03 | 64.95 | 64.57 | 81.61 | 71.17 | — | 72.24 | 76.27 | 65.36 | 11.75 | |
| LLM2Method Category=Foundational2026.04 | 59.17 | — | 63.81 | 79.99 | 81.23 | 73.41 | 54.07 | 53.36 | 68.65 | 80.03 | — | 69.46 | 87.11 | 70.11 | 13.92 | |
| HGTMethod Category=Supervised Relational ML, Hops=22026.04 | 58.37 | — | 66.95 | 86.08 | 88.47 | 77.97 | 64.32 | 63.76 | 82.47 | 70.77 | — | 71.78 | 70.75 | 64.96 | 12.5 | |
| LLM1Method Category=Foundational2026.04 | 57.4 | — | 59.8 | 80 | 78 | 62.1 | 62.7 | 59.8 | 69.3 | 75.8 | — | 68.82 | 91.4 | 71.4 | 13.92 | |
| GNN+TabPFNMethod Category=Foundational2026.04 | 56.68 | — | 64.34 | 85.34 | 87.48 | 77.89 | 65.35 | 60.68 | 84.13 | 64.26 | — | 71.56 | 74.67 | 73.58 | 12.58 | |
| RTzeroMethod Category=Foundational2026.04 | 51.8 | — | 62.8 | 80.1 | 75.7 | 70.9 | 61.8 | 59.5 | 77.47 | 81.2 | — | 67.73 | 89.3 | 73.22 | 13.25 | |
| GriffinMethod Category=Foundational2026.04 | 51 | — | 60.2 | 73.5 | 77.5 | 69 | 60.7 | 45.9 | 83.27 | 57.7 | — | 66.29 | 82.5 | 71.88 | 15.42 |