Question Answering on KQA Pro (dev)
46.45Overall EMRoHTmix
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| RoHTmixKnowledge Source=50% KB + Text2023.05 | 46.45 | 41.76 | 41.73 | 52.21 | 41.95 | 31.26 | 65.45 | 38.76 | |
| RoHTKBKnowledge Source=50% KB2023.05 | 38.94 | 34.16 | 31.54 | 50.91 | 31.61 | 33.69 | 60.4 | 30.52 | |
| BART KoPLKnowledge Source=50% KB2023.05 | 38.04 | 33.1 | 29.4 | 51.81 | 29.92 | 33.69 | 60.12 | 29.03 | |
| RGCNKnowledge Source=50% KB2023.05 | 34.77 | 33.71 | 28.44 | 31.46 | 35.39 | 39.76 | 64.27 | 0.06 | |
| KVMemNNKnowledge Source=50% KB2023.05 | 17.72 | 17.63 | 18.53 | 1.39 | 15.48 | 28.38 | 59.3 | 0.06 | |
| TransferNetKnowledge Source=50% KB + Text2023.05 | 16.8 | 15.94 | 17.93 | 45.35 | 14.84 | 10.47 | 0 | 8.43 |