List your company
ResearchFormerly WizWand

Entity Classification on RELBENCH rel-f1 driver-dnf (test)

0.812AUROCRT
0.535360.607180.6790.75082Jun 6, 2025Aug 3, 2025Sep 30, 2025Nov 27, 2025Jan 24, 2026Mar 23, 2026May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
RTTarget DB in pretraining=No, Parameter count=22M2025.100.812
RTTarget DB in pretraining=Yes, Parameter count=22M2025.100.812
ICL + MLPEvaluation Protocol=MLP on LLM representations2025.060.7841
Rel-LLMEvaluation Protocol=Fine-tuned2025.060.7715
GemmaTarget DB in pretraining=Maybe, Parameter count=27B2025.100.758
Entity MeanTarget DB in pretraining=No, Parameter count=02025.100.754
FROG2026.050.7439
RelGNN2026.050.7345
RDL2026.050.7273
RDLModel Type=GNN + Tabular2025.060.7262
Rel-ZeroEvaluation Protocol=Zero-shot2025.060.7184
RelLLMTarget DB in pretraining=Yes, Parameter count=3B2025.100.718
LightGBMModel Type=Gradient Boosted Trees2025.060.6856
ICLEvaluation Protocol=In-context learning2025.060.6581
LightGBM2026.050.6526
GriffinTarget DB in pretraining=No, Parameter count=22M2025.100.577
GriffinTarget DB in pretraining=Yes, Parameter count=22M2025.100.577
GemmaTarget DB in pretraining=Maybe, Parameter count=4B2025.100.562
GemmaTarget DB in pretraining=Maybe, Parameter count=12B2025.100.546