Knowledge Base Question Answering on LC-QuAD 1.0 (test)
78.1F1 ScoreHGNet
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HGNetBackbone=BERT-Base2021.11 | 78.1 | — | — | 78.7 | — | |
| HGNetGold entity mentions=true2024.06 | 78.1 | — | — | — | — | |
| HGNetBackbone=GloVe + BiLSTM2021.11 | 75.1 | — | — | 76 | — | |
| AQGNet2021.11 | 74.8 | — | — | — | — | |
| AQGNetGold entity mentions=true2024.06 | 74.8 | — | — | — | — | |
| SPARKLEDecoding constraints=Full, Gold entity mentions=false2024.06 | 72.2 | — | — | — | — | |
| DAM2021.11 | 72 | — | — | — | — | |
| Slot-Matching2021.11 | 71 | — | — | — | — | |
| HR-BiLSTM2021.11 | 70 | — | — | — | — | |
| STAGG2021.11 | 69 | — | — | — | — | |
| SPARKLE w/o pruningDecoding constraints=No pruning, Gold entity mentions=false2024.06 | 64.9 | — | — | — | — | |
| EDGQADecomposition=Clue-Decipher2023.06 | 58.8 | 54.8 | 63.5 | — | 0.056 | |
| QDTQAGold entity mentions=false2024.06 | 58.8 | — | — | — | — | |
| SPARKLE w/o constraintsDecoding constraints=None, Gold entity mentions=false2024.06 | 57.3 | — | — | — | — | |
| EDGQADecomposition=DecompRC2023.06 | 56.1 | 52.1 | 60.9 | — | 0.03 | |
| Liang et al. 20212023.06 | 54.9 | 51.1 | 59.3 | — | — | |
| STaG-QA2023.06 | 53.6 | 74.5 | 54.8 | — | — | |
| STaG-QAGold entity mentions=false2024.06 | 53.6 | — | — | — | — | |
| EDGQADecomposition=SplitQA2023.06 | 53.3 | 49.6 | 57.6 | — | 0.002 | |
| EDGQADecomposition=None2023.06 | 53.1 | 50.5 | 56 | — | 0 | |
| EDGQAGold entity mentions=false2024.06 | 53.1 | — | — | — | — | |
| KGQANGold entity mentions=false2024.06 | 51.6 | — | — | — | — | |
| SYGMAKnowledge Base=DBpedia, Reasoning=multi-hop2021.09 | 47 | 47 | 48 | — | — | |
| EDGQADecomposition=HSP2023.06 | 46.7 | 43.3 | 50.7 | — | -0.064 | |
| NSQA2023.06 | 44.5 | 44.8 | 45.8 | — | — | |
| NSQAKnowledge Base=DBpedia, Reasoning=multi-hop2021.09 | 44 | 44 | 45 | — | — | |
| QAMPKnowledge Base=DBpedia, Reasoning=multi-hop2021.09 | 33 | 25 | 50 | — | — | |
| WDAquaKnowledge Base=DBpedia, Reasoning=multi-hop2021.09 | 28 | 22 | 38 | — | — | |
| Sparse-QA2021.11 | — | — | — | 77 | — |