Link Prediction on CODEx L (test)
0.345MRRSupervised SOTA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Supervised SOTATraining Regime=Supervised2023.10 | 0.345 | 0.473 | — | |
| ULTRATraining Regime=Fine-tuned2023.10 | 0.343 | 0.478 | — | |
| ULTRATraining Regime=Zero-shot2023.10 | 0.338 | 0.469 | — | |
| RotatEDimension=500d, Vocabulary size (|V|)=77k + 138, Total Parameters (#P (M))=772021.06 | 0.258 | 0.387 | 100 | |
| NodePiece + RotatE (no relational context)Ablation=no relational context, Vocabulary size (|V|)=7k + 138, Total Parameters (#P (M))=3.12021.06 | 0.201 | 0.332 | 86 | |
| RotatEDimension=20d, Vocabulary size (|V|)=77k + 138, Total Parameters (#P (M))=3.82021.06 | 0.196 | 0.322 | 83 | |
| NodePiece + RotatEVocabulary size (|V|)=7k + 138, Total Parameters (#P (M))=3.62021.06 | 0.19 | 0.313 | 81 | |
| NodePiece + RotatE (no distances)Ablation=no distances, Vocabulary size (|V|)=7k + 138, Total Parameters (#P (M))=3.62021.06 | 0.179 | 0.302 | 78 | |
| NodePiece + RotatE (rels only, no anchors)Ablation=no anchors, Vocabulary size (|V|)=0 + 138, Total Parameters (#P (M))=0.62021.06 | 0.063 | 0.121 | 31 |