Entity Classification on RELBENCH rel-amazon item-churn (test)
83.37AUROCRel-LLM
Evaluation results
| Method | Links | |
|---|---|---|
| Rel-LLMEvaluation Protocol=Fine-tuned2025.06 | 83.37 | |
| RDLModel Type=GNN + Tabular2025.06 | 82.81 | |
| RelGTSupervision regime=fully supervised2026.02 | 82.55 | |
| RDBLearnSupervision regime=no supervised training2026.02 | 82.07 | |
| ICL + MLPEvaluation Protocol=MLP on LLM representations2025.06 | 80.16 | |
| KumoRFMSupervision regime=no supervised training2026.02 | 79.93 | |
| RTSupervision regime=no supervised training2026.02 | 74.3 | |
| RTTarget DB in pretraining=Yes, Parameter count=22M2025.10 | 73.3 | |
| Entity MeanTarget DB in pretraining=No, Parameter count=02025.10 | 73 | |
| ICLEvaluation Protocol=In-context learning2025.06 | 71.96 | |
| LLM-BSupervision regime=no supervised training2026.02 | 71.96 | |
| GriffinSupervision regime=no supervised training2026.02 | 71.9 | |
| GriffinTarget DB in pretraining=Yes, Parameter count=22M2025.10 | 71.9 | |
| RTTarget DB in pretraining=No, Parameter count=22M2025.10 | 70.9 | |
| GriffinTarget DB in pretraining=No, Parameter count=22M2025.10 | 69 | |
| Rel-ZeroEvaluation Protocol=Zero-shot2025.06 | 64.1 | |
| RelLLMSupervision regime=no supervised training2026.02 | 64.1 | |
| RelLLMTarget DB in pretraining=Yes, Parameter count=3B2025.10 | 64.1 | |
| LightGBMModel Type=Gradient Boosted Trees2025.06 | 62.54 | |
| LLM-ASupervision regime=no supervised training2026.02 | 62.1 | |
| GemmaTarget DB in pretraining=Maybe, Parameter count=4B2025.10 | 62.1 | |
| GemmaTarget DB in pretraining=Maybe, Parameter count=12B2025.10 | 55 | |
| GemmaTarget DB in pretraining=Maybe, Parameter count=27B2025.10 | 42.1 |