List your company
ResearchFormerly WizWand

Knowledge Graph Completion on UMLS

0.995Hits@10KERMIT
0.655960.743980.8320.92002Sep 26, 2023Mar 7, 2024Aug 18, 2024Jan 29, 2025Jul 11, 2025Dec 22, 2025Jun 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
KERMITLLM Backbone=qwen2-7b2023.090.9950.9160.8450.986
KERMITLLM Backbone=phi3-small2023.090.9950.9210.8560.983
KERMITLLM Backbone=phi3-medium2023.090.9940.9190.8520.986
CompGCNType=GNN2026.060.9940.9270.867—
RotatEType=Triple2026.060.9930.9250.863—
DiffusionEType=GNN2026.060.9920.970.957—
ConvE2023.090.99———
KG-BERT2023.090.99———
RED-GNNType=GNN2026.060.990.9640.946—
Q-GNNType=GNN2026.060.990.9890.989—
TransE2023.090.989———
DRUMType=Path2026.060.9760.8130.674—
RNNLogic+ + RotatE (Orig + AUG)Base Model=RNNLogic+ + RotatE, Rule Source=RNNLogic rules, Augmentation=AUG2024.070.9650.8420.761—
RNNLogicType=Path2026.060.9650.8420.772—
RNNLogic+ + RotatE (RW + AUG)Base Model=RNNLogic+ + RotatE, Rule Source=Random Walks, Augmentation=AUG2024.070.9640.8380.758—
RNNLogic+ (Orig + AUG)Base Model=RNNLogic+, Rule Source=RNNLogic rules, Augmentation=AUG2024.070.9640.840.752—
RNNLogic+ + RotatE (Orig)Base Model=RNNLogic+ + RotatE, Rule Source=RNNLogic rules, Augmentation=None2024.070.960.8150.712—
RNNLogic+ (RW + AUG)Base Model=RNNLogic+, Rule Source=Random Walks, Augmentation=AUG2024.070.9570.7970.695—
RNNLogic+ (Orig)Base Model=RNNLogic+, Rule Source=RNNLogic rules, Augmentation=None2024.070.9570.8140.712—
RNNLogic+ + RotatE (RW)Base Model=RNNLogic+ + RotatE, Rule Source=Random Walks, Augmentation=None2024.070.9530.820.735—
SimKGC2023.090.9440.7940.7040.865
LERP2023.090.9420.7620.6440.855
RotatE2023.090.9390.7440.6360.822
DRUM2023.090.9350.6950.5460.808
RNNLogic+ (RW)Base Model=RNNLogic+, Rule Source=Random Walks, Augmentation=None2024.070.930.7470.631—
RNNLogic2023.090.9240.7450.630.833
TuckER2023.090.90.7320.6250.812
NeuralLP2023.090.7750.4830.3320.563
DistMult2023.090.6690.3910.2560.445