Entity Classification on RELBENCH rel-f1 driver-dnf (test)
0.812AUROCRT
Evaluation Results
| Method | Links | |
|---|---|---|
| RTTarget DB in pretraining=No, Parameter count=22M2025.10 | 0.812 | |
| RTTarget DB in pretraining=Yes, Parameter count=22M2025.10 | 0.812 | |
| ICL + MLPEvaluation Protocol=MLP on LLM representations2025.06 | 0.7841 | |
| Rel-LLMEvaluation Protocol=Fine-tuned2025.06 | 0.7715 | |
| GemmaTarget DB in pretraining=Maybe, Parameter count=27B2025.10 | 0.758 | |
| Entity MeanTarget DB in pretraining=No, Parameter count=02025.10 | 0.754 | |
| FROG2026.05 | 0.7439 | |
| RelGNN2026.05 | 0.7345 | |
| RDL2026.05 | 0.7273 | |
| RDLModel Type=GNN + Tabular2025.06 | 0.7262 | |
| Rel-ZeroEvaluation Protocol=Zero-shot2025.06 | 0.7184 | |
| RelLLMTarget DB in pretraining=Yes, Parameter count=3B2025.10 | 0.718 | |
| LightGBMModel Type=Gradient Boosted Trees2025.06 | 0.6856 | |
| ICLEvaluation Protocol=In-context learning2025.06 | 0.6581 | |
| LightGBM2026.05 | 0.6526 | |
| GriffinTarget DB in pretraining=No, Parameter count=22M2025.10 | 0.577 | |
| GriffinTarget DB in pretraining=Yes, Parameter count=22M2025.10 | 0.577 | |
| GemmaTarget DB in pretraining=Maybe, Parameter count=4B2025.10 | 0.562 | |
| GemmaTarget DB in pretraining=Maybe, Parameter count=12B2025.10 | 0.546 |