Link Prediction on WN18 Inductive (test)
74.1MRRSupervised SOTA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Supervised SOTATraining Regime=Supervised2023.10 | 74.1 | 82.6 | |
| ULTRATraining Regime=Fine-tuned2023.10 | 68.5 | 79.3 | |
| ULTRATraining Regime=Zero-shot2023.10 | 64.8 | 76.8 | |
| HYPERInference Protocol=Finetuned Inference, Pre-training configuration=3KG + 2HG, Reification=false2025.06 | 44.6 | — | |
| HYPERInference Protocol=End-to-End Inference, Reification=false2025.06 | 43.5 | — | |
| HYPERInference Protocol=Zero-shot Inference, Pre-training configuration=3KG + 2HG, Reification=false2025.06 | 41.5 | — | |
| HCNetInference Protocol=End-to-End Inference, Reification=false2025.06 | 41.4 | — | |
| HYPERInference Protocol=Zero-shot Inference, Pre-training configuration=4HG, Reification=false2025.06 | 37.5 | — | |
| ULTRAInference Protocol=Finetuned Inference, Pre-training configuration=3KG+2HG, Reification=true2025.06 | 34.9 | — | |
| ULTRAInference Protocol=Zero-shot Inference, Pre-training configuration=3KG+2HG, Reification=true2025.06 | 34.1 | — | |
| ULTRAInference Protocol=Zero-shot Inference, Pre-training configuration=4HG, Reification=true2025.06 | 31.9 | — | |
| ULTRAInference Protocol=Zero-shot Inference, Pre-training configuration=3KG, Reification=true2025.06 | 30.5 | — | |
| RD-MPNNInference Protocol=End-to-End Inference, Reification=false2025.06 | 30.4 | — | |
| HYPERInference Protocol=Zero-shot Inference, Pre-training configuration=3KG, Reification=false2025.06 | 25.9 | — | |
| HYPERInference Protocol=Zero-shot Inference, Pre-training configuration=50KG, Reification=false2025.06 | 25.3 | — | |
| HYPERInference Protocol=Zero-shot Inference, Pre-training configuration=4KG, Reification=false2025.06 | 23.1 | — | |
| G-MPNNInference Protocol=End-to-End Inference, Reification=false2025.06 | 17.7 | — | |
| ULTRAInference Protocol=Zero-shot Inference, Pre-training configuration=4KG, Reification=true2025.06 | 12.3 | — | |
| HyperGCNInference Protocol=End-to-End Inference, Reification=false2025.06 | 7.5 | — | |
| HGNNInference Protocol=End-to-End Inference, Reification=false2025.06 | 7.2 | — | |
| ULTRAInference Protocol=Zero-shot Inference, Pre-training configuration=50KG, Reification=true2025.06 | 2.9 | — | |
| DRUMEvaluation Protocol=Inductive2019.10 | — | 9,521 | |
| Neural LPEvaluation Protocol=Inductive2019.10 | — | 9,449 | |
| TransEEvaluation Protocol=Inductive2019.10 | — | 1 |