List your company
ResearchFormerly WizWand

Knowledge Base Question Answering on WebQSP → GraphQA-Pop (test)

67F1FUn-FuSIC(sc)
19.26431.65744.0556.443Nov 15, 2023Dec 21, 2023Jan 26, 2024Mar 3, 2024Apr 8, 2024May 14, 2024Jun 20, 2024
Updated 8mo ago

Evaluation results

MethodLinks
FUn-FuSIC(sc)prior knowledge of answerability=true2024.0667
FUn-FuSIC(scUn)prior knowledge of answerability=false2024.0665
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA and Pangu2023.1161.7
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA and Pangu2023.1161.6
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA2023.1156.8
FuSIC-KBQAprior knowledge of answerability=true2024.0652.3
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA2023.1152.3
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=Pangu2023.1149.1
gf-LLMEvaluation Protocol=Few-shot, Category=LLM ICL2023.1146.6
FuSIC-KBQA-Uprior knowledge of answerability=false2024.0643.4
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=Pangu2023.1141.3
gf-LLMEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1138.1
TIARAEvaluation Protocol=Zero-shot, Category=Supervised2023.1137.8
TIARAEvaluation Protocol=Few-shot, Category=Supervised2023.1137.3
PanguEvaluation Protocol=Few-shot, Category=Supervised2023.1136.7
KB-BinderEvaluation Protocol=Few-shot, Category=LLM ICL2023.1131.5
PanguEvaluation Protocol=Zero-shot, Category=Supervised2023.1125.1
KB-BinderEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1125.1
BERT-RankingEvaluation Protocol=Few-shot, Category=LLM ICL2023.1123.4
BERT-RankingEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1121.1