Knowledge Base Question Answering on WebQSP → GraphQA-Pop (test)
67F1FUn-FuSIC(sc)
Evaluation Results
| Method | Links | |
|---|---|---|
| FUn-FuSIC(sc)prior knowledge of answerability=true2024.06 | 67 | |
| FUn-FuSIC(scUn)prior knowledge of answerability=false2024.06 | 65 | |
| FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA and Pangu2023.11 | 61.7 | |
| FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA and Pangu2023.11 | 61.6 | |
| FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA2023.11 | 56.8 | |
| FuSIC-KBQAprior knowledge of answerability=true2024.06 | 52.3 | |
| FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA2023.11 | 52.3 | |
| FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=Pangu2023.11 | 49.1 | |
| gf-LLMEvaluation Protocol=Few-shot, Category=LLM ICL2023.11 | 46.6 | |
| FuSIC-KBQA-Uprior knowledge of answerability=false2024.06 | 43.4 | |
| FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=Pangu2023.11 | 41.3 | |
| gf-LLMEvaluation Protocol=Zero-shot, Category=LLM ICL2023.11 | 38.1 | |
| TIARAEvaluation Protocol=Zero-shot, Category=Supervised2023.11 | 37.8 | |
| TIARAEvaluation Protocol=Few-shot, Category=Supervised2023.11 | 37.3 | |
| PanguEvaluation Protocol=Few-shot, Category=Supervised2023.11 | 36.7 | |
| KB-BinderEvaluation Protocol=Few-shot, Category=LLM ICL2023.11 | 31.5 | |
| PanguEvaluation Protocol=Zero-shot, Category=Supervised2023.11 | 25.1 | |
| KB-BinderEvaluation Protocol=Zero-shot, Category=LLM ICL2023.11 | 25.1 | |
| BERT-RankingEvaluation Protocol=Few-shot, Category=LLM ICL2023.11 | 23.4 | |
| BERT-RankingEvaluation Protocol=Zero-shot, Category=LLM ICL2023.11 | 21.1 |