List your company
ResearchFormerly WizWand

Entity Classification on RELBENCH rel-stack user-badge (test)

0.9AUROCGelGT
0.609840.685170.76050.83583Jun 6, 2025Aug 2, 2025Sep 28, 2025Nov 24, 2025Jan 20, 2026Mar 18, 2026May 15, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GelGT2026.050.9
Rel-LLMEvaluation Protocol=Fine-tuned2025.060.8964
Rel-LLM2026.050.89
Nodeformer2026.050.89
RDLModel Type=GNN + Tabular2025.060.8886
ICL + MLPEvaluation Protocol=MLP on LLM representations2025.060.8819
GriffinTarget DB in pretraining=Yes, Parameter count=22M2025.100.823
RTTarget DB in pretraining=Yes, Parameter count=22M2025.100.811
RTTarget DB in pretraining=No, Parameter count=22M2025.100.801
GemmaTarget DB in pretraining=Maybe, Parameter count=27B2025.100.8
GemmaTarget DB in pretraining=Maybe, Parameter count=12B2025.100.798
GemmaTarget DB in pretraining=Maybe, Parameter count=4B2025.100.791
GriffinTarget DB in pretraining=No, Parameter count=22M2025.100.735
ICLEvaluation Protocol=In-context learning2025.060.7113
Entity MeanTarget DB in pretraining=No, Parameter count=02025.100.662
LightGBMModel Type=Gradient Boosted Trees2025.060.6343
Rel-ZeroEvaluation Protocol=Zero-shot2025.060.6212
RelLLMTarget DB in pretraining=Yes, Parameter count=3B2025.100.621