Abductive Reasoning on WN18RR (test)
0.851p ScoreEncoder-Decoder + RLF-KG
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Encoder-Decoder + RLF-KGArchitecture=Encoder-Decoder, RLF-KG=true2023.12 | 0.85 | 0.778 | 0.765 | 0.763 | 0.854 | 0.685 | 0.767 | 0.719 | 0.743 | 0.732 | 0.738 | 0.682 | 0.71 | 0.753 | |
| Decoder-Only + RLF-KGArchitecture=Decoder-Only, RLF-KG=true2023.12 | 0.821 | 0.76 | 0.694 | 0.693 | 0.827 | 0.656 | 0.77 | 0.68 | 0.717 | 0.704 | 0.72 | 0.676 | 0.721 | 0.726 | |
| Encoder-DecoderArchitecture=Encoder-Decoder, RLF-KG=false2023.12 | 0.793 | 0.734 | 0.692 | 0.692 | 0.797 | 0.627 | 0.763 | 0.69 | 0.707 | 0.694 | 0.704 | 0.653 | 0.664 | 0.708 | |
| Decoder-OnlyArchitecture=Decoder-Only, RLF-KG=false2023.12 | 0.76 | 0.734 | 0.68 | 0.684 | 0.77 | 0.614 | 0.725 | 0.65 | 0.683 | 0.672 | 0.688 | 0.66 | 0.677 | 0.692 |