Knowledge Graph Completion on WN18 (test)
0.987Hits@10LERP
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| LERPCategory=Rule Learning2023.05 | 0.987 | — | — | — | — | — | 0.958 | 93.2 | 98.2 | — | |
| Best PublishedSetting=Past SOTA2018.06 | 0.97 | — | — | — | — | — | 0.94 | — | — | — | |
| DaBRScoring Function=Semantic and Geometric (SG)2024.12 | 0.966 | — | — | — | — | — | 0.954 | 94.6 | 95.9 | 56 | |
| TransERRScoring Function=Geometric Distance (GD)2024.12 | 0.965 | — | — | — | — | — | 0.953 | 94.5 | 95.7 | 82 | |
| Inverse ModelCategory=No Rule Learning2023.05 | 0.964 | — | — | — | — | — | 0.963 | 95.3 | 96.4 | — | |
| QuatREScoring Function=Semantic Matching (SM)2024.12 | 0.963 | — | — | — | — | — | 0.939 | 94.6 | 95.3 | 116 | |
| RotateCTScoring Function=Geometric Distance (GD)2024.12 | 0.963 | — | — | — | — | — | 0.951 | 94.4 | 95.6 | 201 | |
| Rotate4DScoring Function=Geometric Distance (GD)2024.12 | 0.963 | — | — | — | — | — | 0.952 | 94.6 | 95.6 | 173 | |
| DCNEScoring Function=Geometric Distance (GD)2024.12 | 0.963 | — | — | — | — | — | 0.952 | 94.5 | 95.5 | 192 | |
| DualEScoring Function=Semantic Matching (SM)2024.12 | 0.962 | — | — | — | — | — | 0.952 | 94.6 | 95.6 | 156 | |
| AutoBLMModel Category=AutoBLM2021.07 | 0.961 | — | — | — | — | — | 0.952 | 94.7 | — | — | |
| AutoBLM+Model Category=AutoBLM2021.07 | 0.961 | — | — | — | — | — | 0.952 | 94.7 | — | — | |
| LinearRECategory=No Rule Learning2023.05 | 0.961 | — | — | — | — | — | 0.952 | 94.7 | 95.5 | — | |
| QuatDECategory=No Rule Learning2023.05 | 0.961 | — | — | — | — | — | 0.95 | 94.4 | 95.4 | — | |
| Rotate3DScoring Function=Geometric Distance (GD)2024.12 | 0.961 | — | — | — | — | — | 0.951 | 94.5 | 95.3 | 214 | |
| ComplEx-N3Setting=Standard, Regularizer=N32018.06 | 0.96 | — | — | — | — | — | 0.95 | — | — | — | |
| CP-N3Setting=Reciprocal, Regularizer=N32018.06 | 0.96 | — | — | — | — | — | 0.95 | — | — | — | |
| ComplEx-FROSetting=Reciprocal, Regularizer=FRO2018.06 | 0.96 | — | — | — | — | — | 0.95 | — | — | — | |
| ComplEx-N3Setting=Reciprocal, Regularizer=N32018.06 | 0.96 | — | — | — | — | — | 0.95 | — | — | — | |
| Trans4EScoring Function=Geometric Distance (GD)2024.12 | 0.96 | — | — | — | — | — | 0.95 | 94.4 | 95.3 | 175 | |
| RotatEModel Category=TDM2021.07 | 0.959 | — | — | — | — | — | 0.949 | 94.4 | — | — | |
| SimplE/CPModel Category=BLM2021.07 | 0.959 | — | — | — | — | — | 0.95 | 94.5 | — | — | |
| QuatEModel Category=BLM2021.07 | 0.959 | — | — | — | — | — | 0.95 | 94.5 | — | — | |
| QuatEScoring Function=Semantic Matching (SM)2024.12 | 0.959 | — | — | — | — | — | 0.95 | 94.5 | 95.4 | 162 | |
| TuckERModel Category=BLM2021.07 | 0.958 | — | — | — | — | — | 0.953 | 94.9 | — | — | |
| TuckERScoring Function=Semantic Matching (SM)2024.12 | 0.958 | — | — | — | — | — | 0.953 | 94.9 | 95.5 | — | |
| HolE/ComplExModel Category=BLM2021.07 | 0.957 | — | — | — | — | — | 0.951 | 94.5 | — | — | |
| AnalogyModel Category=BLM2021.07 | 0.957 | — | — | — | — | — | 0.95 | 94.6 | — | — | |
| Quaternion-based four-embeddingModel type=Interaction mechanism2019.03 | 0.956 | — | — | — | 0.95 | — | 0.941 | 93.1 | — | — | |
| ConvECategory=No Rule Learning2023.05 | 0.956 | — | — | — | — | — | 0.943 | 93.5 | 94.6 | — | |
| ConvEModel Category=NNM2021.07 | 0.955 | — | — | — | — | — | 0.942 | 93.5 | — | — | |
| DRUMCategory=Rule Learning2023.05 | 0.954 | — | — | — | — | — | 0.944 | 93.9 | 94.3 | — | |
| RSNModel Category=NNM2021.07 | 0.953 | — | — | — | — | — | 0.94 | 92.2 | — | — | |
| DistMultModel Category=BLM2021.07 | 0.952 | — | — | — | — | — | 0.821 | 71.7 | — | — | |
| ComplExWeight setting=(1, 0, 0, 1, 0, -1, 1, 0)2019.03 | 0.951 | — | — | — | 0.946 | — | 0.937 | 92.8 | — | — | |
| ComplExSetting=Past SOTA2018.06 | 0.95 | — | — | — | — | — | 0.94 | — | — | — | |
| ConvESetting=Past SOTA2018.06 | 0.95 | — | — | — | — | — | 0.94 | — | — | — | |
| CP-FROSetting=Reciprocal, Regularizer=FRO2018.06 | 0.95 | — | — | — | — | — | 0.95 | — | — | — | |
| Good example 2Weight setting=(1, 1, -1, 1, 1, -1, 1, 1)2019.03 | 0.95 | — | — | — | 0.944 | — | 0.938 | 93 | — | — | |
| HolEEvaluation Protocol=filtered, Modeling Analogies=true, External Data Usage=false2017.05 | 0.949 | — | — | — | — | — | — | — | — | — | |
| CPhWeight setting=(0, 0, 1, 0, 0, 1, 0, 0)2019.03 | 0.949 | — | — | — | 0.944 | — | 0.937 | 92.9 | — | — | |
| ComplExEvaluation Protocol=filtered, Modeling Analogies=true, External Data Usage=false2017.05 | 0.947 | — | — | — | — | — | — | — | — | — | |
| ANALOGYEvaluation Protocol=filtered, Modeling Analogies=true, External Data Usage=false2017.05 | 0.947 | — | — | — | — | — | — | — | — | — | |
| Bad example 2Weight setting=(0, 0, 1, 1, 1, 1, 0, 0)2019.03 | 0.947 | — | — | — | 0.917 | — | 0.794 | 66.6 | — | — | |
| ComplExCategory=No Rule Learning2023.05 | 0.947 | — | — | — | — | — | 0.941 | 93.6 | 93.6 | — | |
| Good example 1Weight setting=(0, 0, 20, 1, 1, 20, 0, 0)2019.03 | 0.946 | — | — | — | 0.942 | — | 0.938 | 93.4 | — | — | |
| Auto weightRestriction=sigmoid, Range=(0, 1)2019.03 | 0.946 | — | — | — | 0.915 | — | 0.789 | 66.1 | — | — | |
| TransHModel Category=TDM2021.07 | 0.945 | — | — | — | — | — | 0.521 | — | — | — | |
| DistMultWeight setting=(1, 0, 0, 0, 0, 0, 0, 0)2019.03 | 0.945 | — | — | — | 0.915 | — | 0.796 | 67.4 | — | — | |
| Auto weightRestriction=sigmoid, Range=(0, 1), Sparsity=sparse2019.03 | 0.945 | — | — | — | 0.915 | — | 0.793 | 66.7 | — | — | |
| Neural LPCategory=Rule Learning2023.05 | 0.945 | — | — | — | — | — | 0.94 | — | — | — | |
| Uniform weightWeight setting=(1, 1, 1, 1, 1, 1, 1, 1)2019.03 | 0.944 | — | — | — | 0.915 | — | 0.787 | 65.8 | — | — | |
| Auto weightRestriction=none2019.03 | 0.944 | — | — | — | 0.911 | — | 0.774 | 63.6 | — | — | |
| Auto weightRestriction=softmax, Range=(0, 1)2019.03 | 0.944 | — | — | — | 0.915 | — | 0.802 | 68.5 | — | — | |
| Auto weightRestriction=softmax, Range=(0, 1), Sparsity=sparse2019.03 | 0.944 | — | — | — | 0.915 | — | 0.803 | 68.8 | — | — | |
| NLFEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=true2017.05 | 0.943 | — | — | — | — | — | — | — | — | — | |
| Auto weightRestriction=tanh, Range=(-1, 1)2019.03 | 0.943 | — | — | — | 0.908 | — | 0.765 | 62.5 | — | — | |
| Auto weightRestriction=tanh, Range=(-1, 1), Sparsity=sparse2019.03 | 0.943 | — | — | — | 0.91 | — | 0.763 | 61.3 | — | — | |
| TransECategory=No Rule Learning2023.05 | 0.943 | — | — | — | — | — | 0.495 | 11.3 | 88.8 | — | |
| DistMultSetting=Past SOTA2018.06 | 0.94 | — | — | — | — | — | 0.82 | — | — | — | |
| TransSparseEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.939 | — | — | — | — | — | — | — | — | — | |
| DistMultEvaluation Protocol=filtered, Modeling Analogies=true, External Data Usage=false2017.05 | 0.936 | — | — | — | — | — | — | — | — | — | |
| Auto weightRestriction=none, Sparsity=sparse2019.03 | 0.935 | — | — | — | 0.892 | — | 0.792 | 68.5 | — | — | |
| STransEEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.934 | — | — | — | — | — | — | — | — | — | |
| KG2EEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.932 | — | — | — | — | — | — | — | — | — | |
| CTransREvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.923 | — | — | — | — | — | — | — | — | — | |
| TransDEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.922 | — | — | — | — | — | — | — | — | — | |
| TransREvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.92 | — | — | — | — | — | — | — | — | — | |
| TransEEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.892 | — | — | — | — | — | — | — | — | — | |
| TransHEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.867 | — | — | — | — | — | — | — | — | — | |
| LFMEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.816 | — | — | — | — | — | — | — | — | — | |
| SEEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.805 | — | — | — | — | — | — | — | — | — | |
| SMEEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.741 | — | — | — | — | — | — | — | — | — | |
| NTNEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.661 | — | — | — | — | — | — | — | — | — | |
| RESCALEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.528 | — | — | — | — | — | — | — | — | — | |
| UnstructuredEvaluation Protocol=filtered, Modeling Analogies=false, External Data Usage=false2017.05 | 0.382 | — | — | — | — | — | — | — | — | — | |
| CP-N3Setting=Standard, Regularizer=N32018.06 | 0.33 | — | — | — | — | — | 0.2 | — | — | — | |
| Bad example 1Weight setting=(0, 0, 20, 0, 0, 1, 0, 0)2019.03 | 0.159 | — | — | — | 0.116 | — | 0.107 | 7.9 | — | — | |
| CPWeight setting=(0, 0, 1, 0, 0, 0, 0, 0)2019.03 | 0.139 | — | — | — | 0.093 | — | 0.086 | 5.9 | — | — | |
| CPSetting=Past SOTA2018.06 | 0.13 | — | — | — | — | — | 0.08 | — | — | — | |
| ComplExrank (K)=150, negative samples (η)=12017.02 | — | 0.941 | 0.587 | 0.936 | 0.945 | 0.947 | — | — | — | — | |
| CP2017.02 | — | 0.075 | 0.058 | 0.049 | 0.08 | 0.125 | — | — | — | — | |
| DistMult2017.02 | — | 0.822 | 0.532 | 0.728 | 0.914 | 0.936 | — | — | — | — | |
| HolEresults source=Nickel et al. (2016b)2017.02 | — | 0.938 | 0.616 | 0.93 | 0.945 | 0.949 | — | — | — | — | |
| RESCAL2017.02 | — | 0.894 | 0.583 | 0.867 | 0.918 | 0.935 | — | — | — | — | |
| TransE2017.02 | — | 0.454 | 0.335 | 0.089 | 0.823 | 0.934 | — | — | — | — |