Inductive Link Prediction on FB15k-237 inductive (test)
29.13Hits@10DRUM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DRUMEvaluation Protocol=Inductive2019.10 | 29.13 | — | — | — | |
| Neural LPEvaluation Protocol=Inductive2019.10 | 27.97 | — | — | — | |
| NBFNetClass=GNNs2021.06 | 0.834 | — | — | — | |
| GraILClass=GNNs2021.06 | 0.642 | — | — | — | |
| TransEEvaluation Protocol=Inductive2019.10 | 0.53 | — | — | — | |
| NeuralLPClass=Path-based2021.06 | 0.529 | — | — | — | |
| DRUMClass=Path-based2021.06 | 0.529 | — | — | — | |
| FnF-TGModality=Structure-Informed, Backbone=BERT-Base2024.08 | 0.524 | 0.316 | 0.214 | 0.35 | |
| FnF-TGModality=Structure-Informed, Backbone=BERT-Small2024.08 | 0.518 | 0.316 | 0.216 | 0.354 | |
| FnF-TGModality=Structure-Informed, Backbone=BERT-Medium2024.08 | 0.515 | 0.314 | 0.214 | 0.353 | |
| FnF-TGBERTTINYTraining=IND2024.08 | 0.514 | 0.282 | 0.176 | 0.311 | |
| FnF-TGModality=Structure-Informed, Backbone=BERT-Mini2024.08 | 0.502 | 0.302 | 0.204 | 0.337 | |
| RuleNClass=Path-based2021.06 | 0.498 | — | — | — | |
| FnF-TGModality=Structure-Informed, Backbone=BERT-Tiny2024.08 | 0.475 | 0.288 | 0.195 | 0.318 | |
| FnF-TGBERTTINYTraining=IND2024.08 | 0.475 | 0.288 | 0.195 | 0.318 | |
| FnF-TModality=Text-Only, Backbone=BERT-Base2024.08 | 0.453 | 0.266 | 0.174 | 0.297 | |
| FnF-TModality=Text-Only, Backbone=BERT-Medium2024.08 | 0.431 | 0.253 | 0.164 | 0.281 | |
| FnF-TGBERTTINYTraining=FIR2024.08 | 0.418 | 0.249 | 0.165 | 0.274 | |
| FnF-TModality=Text-Only, Backbone=BERT-Small2024.08 | 0.411 | 0.239 | 0.152 | 0.265 | |
| STATIKModality=Structure-Informed, Backbone=BERT-Base2024.08 | 0.381 | 0.224 | 0.143 | 0.248 | |
| BLPModality=Text-Only, Backbone=BERT-Base2024.08 | 0.363 | 0.195 | 0.113 | 0.213 | |
| BLP-TransE†2022.01 | 0.363 | 0.195 | 0.113 | 0.213 | |
| FnF-TModality=Text-Only, Backbone=BERT-Mini2024.08 | 0.354 | 0.204 | 0.128 | 0.223 | |
| BOWModality=Text-Only, Backbone=BERT-Base2024.08 | 0.316 | 0.173 | 0.103 | 0.184 | |
| BE-BOW+2022.01 | 0.316 | 0.173 | 0.103 | 0.184 | |
| STARModality=Structure-Informed, Backbone=BERT-Base2024.08 | 0.309 | 0.163 | 0.092 | 0.176 | |
| FnF-TBERTTINYTraining=IND2024.08 | 0.308 | 0.171 | 0.102 | 0.185 | |
| kNN-KGE2022.01 | 0.293 | 0.198 | 0.146 | 0.214 | |
| FnF-TModality=Text-Only, Backbone=BERT-Tiny2024.08 | 0.289 | 0.164 | 0.1 | 0.176 | |
| FnF-TBERTTINYTraining=IND2024.08 | 0.289 | 0.164 | 0.1 | 0.176 | |
| BLP-DistMult†2022.01 | 0.286 | 0.146 | 0.076 | 0.156 | |
| BLP-ComplEx†2022.01 | 0.283 | 0.148 | 0.081 | 0.154 | |
| DKRLModality=Text-Only, Backbone=BERT-Base2024.08 | 0.263 | 0.144 | 0.084 | 0.151 | |
| BE-DKRL+2022.01 | 0.263 | 0.144 | 0.084 | 0.151 | |
| FnF-TBERTTINYTraining=FIR2024.08 | 0.253 | 0.143 | 0.087 | 0.153 | |
| FnF-TGBERTTINYTraining=FIR2024.08 | 0.099 | 0.05 | 0.023 | 0.051 | |
| FnF-TBERTTINYTraining=FIR2024.08 | 0.052 | 0.024 | 0.007 | 0.026 | |
| Random baseline2024.08 | — | 0.0007 | — | — |