Knowledge Graph Completion on UMLS
0.995Hits@10KERMIT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| KERMITLLM Backbone=qwen2-7b2023.09 | 0.995 | 0.916 | 0.845 | 0.986 | |
| KERMITLLM Backbone=phi3-small2023.09 | 0.995 | 0.921 | 0.856 | 0.983 | |
| KERMITLLM Backbone=phi3-medium2023.09 | 0.994 | 0.919 | 0.852 | 0.986 | |
| CompGCNType=GNN2026.06 | 0.994 | 0.927 | 0.867 | — | |
| RotatEType=Triple2026.06 | 0.993 | 0.925 | 0.863 | — | |
| DiffusionEType=GNN2026.06 | 0.992 | 0.97 | 0.957 | — | |
| ConvE2023.09 | 0.99 | — | — | — | |
| KG-BERT2023.09 | 0.99 | — | — | — | |
| RED-GNNType=GNN2026.06 | 0.99 | 0.964 | 0.946 | — | |
| Q-GNNType=GNN2026.06 | 0.99 | 0.989 | 0.989 | — | |
| TransE2023.09 | 0.989 | — | — | — | |
| DRUMType=Path2026.06 | 0.976 | 0.813 | 0.674 | — | |
| RNNLogic+ + RotatE (Orig + AUG)Base Model=RNNLogic+ + RotatE, Rule Source=RNNLogic rules, Augmentation=AUG2024.07 | 0.965 | 0.842 | 0.761 | — | |
| RNNLogicType=Path2026.06 | 0.965 | 0.842 | 0.772 | — | |
| RNNLogic+ + RotatE (RW + AUG)Base Model=RNNLogic+ + RotatE, Rule Source=Random Walks, Augmentation=AUG2024.07 | 0.964 | 0.838 | 0.758 | — | |
| RNNLogic+ (Orig + AUG)Base Model=RNNLogic+, Rule Source=RNNLogic rules, Augmentation=AUG2024.07 | 0.964 | 0.84 | 0.752 | — | |
| RNNLogic+ + RotatE (Orig)Base Model=RNNLogic+ + RotatE, Rule Source=RNNLogic rules, Augmentation=None2024.07 | 0.96 | 0.815 | 0.712 | — | |
| RNNLogic+ (RW + AUG)Base Model=RNNLogic+, Rule Source=Random Walks, Augmentation=AUG2024.07 | 0.957 | 0.797 | 0.695 | — | |
| RNNLogic+ (Orig)Base Model=RNNLogic+, Rule Source=RNNLogic rules, Augmentation=None2024.07 | 0.957 | 0.814 | 0.712 | — | |
| RNNLogic+ + RotatE (RW)Base Model=RNNLogic+ + RotatE, Rule Source=Random Walks, Augmentation=None2024.07 | 0.953 | 0.82 | 0.735 | — | |
| SimKGC2023.09 | 0.944 | 0.794 | 0.704 | 0.865 | |
| LERP2023.09 | 0.942 | 0.762 | 0.644 | 0.855 | |
| RotatE2023.09 | 0.939 | 0.744 | 0.636 | 0.822 | |
| DRUM2023.09 | 0.935 | 0.695 | 0.546 | 0.808 | |
| RNNLogic+ (RW)Base Model=RNNLogic+, Rule Source=Random Walks, Augmentation=None2024.07 | 0.93 | 0.747 | 0.631 | — | |
| RNNLogic2023.09 | 0.924 | 0.745 | 0.63 | 0.833 | |
| TuckER2023.09 | 0.9 | 0.732 | 0.625 | 0.812 | |
| NeuralLP2023.09 | 0.775 | 0.483 | 0.332 | 0.563 | |
| DistMult2023.09 | 0.669 | 0.391 | 0.256 | 0.445 |