Link Prediction on Wikidata5M (test)
0.493MRRBLP-SimplE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BLP-SimplEEvaluation protocol=transfer evaluation, Decoder=SimplE2020.10 | 0.493 | 0.289 | 0.639 | 0.866 | |
| BLP-ComplExEvaluation protocol=transfer evaluation, Decoder=ComplEx2020.10 | 0.489 | 0.262 | 0.664 | 0.877 | |
| BLP-TransEEvaluation protocol=transfer evaluation, Decoder=TransE2020.10 | 0.478 | 0.241 | 0.66 | 0.871 | |
| BLP-DistMultEvaluation protocol=transfer evaluation, Decoder=DistMult2020.10 | 0.472 | 0.242 | 0.646 | 0.869 | |
| KGT5-context + Desc.Params=60M, Add. requirements for inference=1-hop neighborhood, Pre-trained=no2023.05 | 0.426 | 0.406 | 0.44 | 0.46 | |
| SimKGC + Desc. + Hard Negative EnsembleParams=1,100M, Add. requirements for inference=entity embeddings, Pre-trained=yes2023.05 | 0.42 | 0.381 | 0.435 | 0.49 | |
| KEPLEREvaluation protocol=transfer evaluation2020.10 | 0.402 | 0.222 | 0.514 | 0.73 | |
| KGT5 + Desc.Params=60M, Add. requirements for inference=null, Pre-trained=no2023.05 | 0.381 | 0.357 | 0.397 | 0.422 | |
| KGT5-contextParams=60M, Add. requirements for inference=1-hop neighborhood, Pre-trained=no2023.05 | 0.378 | 0.35 | 0.396 | 0.427 | |
| BE-BOWEvaluation protocol=transfer evaluation, Embeddings=BERT (WordPiece)2020.10 | 0.362 | 0.082 | 0.586 | 0.798 | |
| SimKGC + Desc.Params=220M, Add. requirements for inference=entity embeddings, Pre-trained=yes2023.05 | 0.358 | 0.313 | 0.376 | 0.441 | |
| GloVe-BOWEvaluation protocol=transfer evaluation, Embeddings=GloVe2020.10 | 0.343 | 0.092 | 0.531 | 0.756 | |
| KGT5-ComplEx EnsembleParams=674M2022.03 | 0.336 | 0.286 | 0.362 | 0.426 | |
| KGT5 + ComplExParams=674M, Add. requirements for inference=null, Pre-trained=no2023.05 | 0.336 | 0.286 | 0.362 | 0.426 | |
| BE-DKRLEvaluation protocol=transfer evaluation, Embeddings=BERT (WordPiece)2020.10 | 0.322 | 0.097 | 0.474 | 0.72 | |
| ComplExParams=614M2022.03 | 0.308 | 0.255 | — | 0.398 | |
| ComplExDim=128, Epochs=3002022.07 | 0.308 | — | — | — | |
| ComplExParams=614M, Add. requirements for inference=null, Pre-trained=no2023.05 | 0.308 | 0.255 | — | 0.398 | |
| KGT5Params=60M2022.03 | 0.3 | 0.267 | 0.318 | 0.365 | |
| GRASHVariant Model=ComplEx, Reduction Variant=Epoch, Dim=1282022.07 | 0.3 | — | — | — | |
| GRASHVariant Model=ComplEx, Reduction Variant=Graph, Dim=1282022.07 | 0.3 | — | — | — | |
| GRASHVariant Model=ComplEx, Reduction Variant=Comb., Dim=1282022.07 | 0.3 | — | — | — | |
| KGT5Params=60M, Add. requirements for inference=null, Pre-trained=no2023.05 | 0.3 | 0.267 | 0.318 | 0.365 | |
| SimplEParams=2,400M2022.03 | 0.296 | 0.252 | 0.317 | 0.377 | |
| SimpleParams=2,400M, Add. requirements for inference=null, Pre-trained=no2023.05 | 0.296 | 0.252 | 0.317 | 0.377 | |
| GRASHVariant Model=ComplEx, Reduction Variant=Comb., Dim=5122022.07 | 0.294 | — | — | — | |
| RotatEParams=2,400M2022.03 | 0.29 | 0.234 | 0.322 | 0.39 | |
| RotatEDim=512, Epochs=10002022.07 | 0.29 | — | — | — | |
| RotatEParams=2,400M2023.05 | 0.29 | 0.234 | 0.322 | 0.39 | |
| GloVe-DKRLEvaluation protocol=transfer evaluation, Embeddings=GloVe2020.10 | 0.282 | 0.077 | 0.403 | 0.66 | |
| QuatEParams=2,400M2022.03 | 0.276 | 0.227 | 0.301 | 0.359 | |
| GRASHVariant Model=TransE, Reduction Variant=Comb., Dim=1282022.07 | 0.268 | — | — | — | |
| GRASHVariant Model=TransE, Reduction Variant=Epoch, Dim=1282022.07 | 0.263 | — | — | — | |
| GRASHVariant Model=TransE, Reduction Variant=Graph, Dim=1282022.07 | 0.263 | — | — | — | |
| GRASHVariant Model=RotatE, Reduction Variant=Comb., Dim=5122022.07 | 0.261 | — | — | — | |
| TransEParams=2,400M2022.03 | 0.253 | 0.17 | 0.311 | 0.392 | |
| DistMultParams=2,400M2022.03 | 0.253 | 0.209 | 0.278 | 0.334 | |
| TransEDim=512, Epochs=10002022.07 | 0.253 | — | — | — | |
| TransEParams=2,400M2023.05 | 0.253 | 0.17 | 0.311 | 0.392 | |
| DistMultParams=2,400M2023.05 | 0.253 | 0.209 | 0.278 | 0.334 | |
| GRASHVariant Model=TransE, Reduction Variant=Comb., Dim=5122022.07 | 0.249 | — | — | — | |
| GRASHVariant Model=RotatE, Reduction Variant=Epoch, Dim=1282022.07 | 0.241 | — | — | — | |
| GRASHVariant Model=RotatE, Reduction Variant=Comb., Dim=1282022.07 | 0.241 | — | — | — | |
| ComplExParams=125M, dimension=26-dim2022.03 | 0.239 | 0.187 | 0.261 | 0.342 | |
| GRASHVariant Model=RotatE, Reduction Variant=Graph, Dim=1282022.07 | 0.232 | — | — | — | |
| MLMLMParams=355M2022.03 | 0.223 | 0.201 | 0.232 | 0.264 | |
| MLMLMParams=355M2023.05 | 0.223 | 0.201 | 0.232 | 0.264 | |
| SimKGCParams=220M, Add. requirements for inference=entity embeddings, Pre-trained=yes2023.05 | 0.212 | 0.182 | 0.223 | 0.266 | |
| MEKERSparse embeddings=false, Batch size=256, Evaluation protocol=Unfiltered, Memory (GB)=22.27, Storage (GB)=02022.04 | 0.211 | 0.149 | 0.238 | 0.325 | |
| KEPLERParams=125M2022.03 | 0.21 | 0.173 | 0.224 | 0.277 | |
| KEPLERParams=125M2023.05 | 0.21 | 0.173 | 0.224 | 0.277 | |
| LibKGE sparse (ComplEX)Backbone=ComplEX, Framework=LibKGE, Sparse embeddings=true, Batch size=256, Evaluation protocol=Unfiltered, Memory (GB)=21.42, Storage (GB)=02022.04 | 0.202 | 0.16 | 0.233 | 0.316 | |
| ComplExParams=67M, dimension=14-dim2022.03 | 0.201 | 0.161 | 0.211 | 0.275 | |
| PTBG (ComplEX)Backbone=ComplEX, Framework=PyTorch-BigGraph, Sparse embeddings=false, Batch size=256, Evaluation protocol=Unfiltered, Memory (GB)=45.15, Storage (GB)=9.252022.04 | 0.184 | 0.131 | 0.21 | 0.287 | |
| DKRLParams=20M2022.03 | 0.16 | 0.12 | 0.181 | 0.229 | |
| DKRLParams=20M2023.05 | 0.16 | 0.12 | 0.181 | 0.229 | |
| PTBG (TransE)Backbone=TransE, Framework=PyTorch-BigGraph, Sparse embeddings=false, Batch size=256, Evaluation protocol=Unfiltered, Memory (GB)=43.64, Storage (GB)=9.252022.04 | 0.15 | 0.091 | 0.176 | 0.263 | |
| LibKGE sparse (TransE)Backbone=TransE, Framework=LibKGE, Sparse embeddings=true, Batch size=256, Evaluation protocol=Unfiltered, Memory (GB)=33.29, Storage (GB)=02022.04 | 0.142 | 0.153 | 0.211 | 0.252 |