Relational Knowledge Probing on LAMA original (test)
23.13G-RE ScoreLM-CORE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LM-CORE2023.02 | 23.13 | 55.32 | 17.28 | 16.15 | |
| BERT-baseBackbone=BERT-base2023.02 | 9.12 | 30.83 | 14.29 | 15.88 | |
| BART-largeBackbone=BART-large2023.02 | 7.76 | 26 | 16.07 | 11.19 | |
| KILMBackbone=BART-large2023.02 | 6.83 | 26.14 | 16.96 | 11.19 | |
| ERNIEBackbone=BERT-base2023.02 | 6.62 | 27.58 | 13.62 | 14.83 | |
| BART-baseBackbone=BART-base2023.02 | 5.7 | 22.14 | 13.88 | 6.29 | |
| BART-base + MergeBackbone=BART-base, Variant=Merge2023.02 | 5.5 | 24.98 | 13.03 | 7.69 | |
| KALMModel size=large2023.02 | 5.41 | 28.12 | 10.7 | 11.89 | |
| KILMBackbone=BART-base2023.02 | 4.02 | 23.41 | 12.8 | 8.39 | |
| KALMModel size=base2023.02 | 3.27 | 25.96 | 8.61 | 6.64 | |
| KILMDUBackbone=BART-large2023.02 | 3.1 | 24.99 | 16.22 | 12.94 |