List your company
ResearchFormerly WizWand

Knowledge Base Question Answering on WebQSP -> GrailQA-Tech (test)

74.6F1 ScoreFuSIC-KBQA
19.37633.71348.0562.387Nov 15, 2023Dec 21, 2023Jan 26, 2024Mar 3, 2024Apr 8, 2024May 14, 2024Jun 20, 2024
Updated 8mo ago

Evaluation results

MethodLinks
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA and Pangu2023.1174.6
FUn-FuSIC(sc)prior knowledge of answerability=true2024.0673.6
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA and Pangu2023.1171.4
FUn-FuSIC(scUn)prior knowledge of answerability=false2024.0671.2
FuSIC-KBQAprior knowledge of answerability=true2024.0670.8
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA2023.1170.8
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=Pangu2023.1170.3
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA2023.1168.4
KB-BinderEvaluation Protocol=Few-shot, Category=LLM ICL2023.1168
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA and Pangu2023.1165.1
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=Pangu2023.1165.1
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=TIARA2023.1165
FuSIC-KBQA-Uprior knowledge of answerability=false2024.0662.6
FuSIC-KBQAEvaluation Protocol=Few-shot, Category=Fusion, Retriever=Pangu2023.1161.9
gf-LLMEvaluation Protocol=Few-shot, Category=LLM ICL2023.1161.2
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA and Pangu2023.1156.6
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=TIARA2023.1155.9
KB-BinderEvaluation Protocol=Few-shot, Category=LLM ICL2023.1155.7
gf-LLMEvaluation Protocol=Few-shot, Category=LLM ICL2023.1153.4
FuSIC-KBQAEvaluation Protocol=Zero-shot, Category=Fusion, Retriever=Pangu2023.1152.5
PanguEvaluation Protocol=Few-shot, Category=Supervised2023.1151
TIARAEvaluation Protocol=Few-shot, Category=Supervised2023.1148.2
PanguEvaluation Protocol=Few-shot, Category=Supervised2023.1145.3
gf-LLMEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1142.8
PanguEvaluation Protocol=Zero-shot, Category=Supervised2023.1140.8
TIARAEvaluation Protocol=Few-shot, Category=Supervised2023.1140.6
PanguEvaluation Protocol=Zero-shot, Category=Supervised2023.1139.3
KB-BinderEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1139
BERT-RankingEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1135.9
BERT-RankingEvaluation Protocol=Few-shot, Category=LLM ICL2023.1134.4
KB-BinderEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1133.6
BERT-RankingEvaluation Protocol=Few-shot, Category=LLM ICL2023.1133.1
gf-LLMEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1131.3
TIARAEvaluation Protocol=Zero-shot, Category=Supervised2023.1130.6
TIARAEvaluation Protocol=Zero-shot, Category=Supervised2023.1130
BERT-RankingEvaluation Protocol=Zero-shot, Category=LLM ICL2023.1121.5