List your company
ResearchFormerly WizWand

Open-Domain Question Answering on WebQuestions (WQ)

45.2Exact Match (EM)RAG
25.85630.87835.940.922Oct 30, 2022
Updated 8mo ago

Evaluation results

MethodLinks
RAGModel Type=Retrieval-augmented2022.1045.2
DPRModel Type=Retrieval-augmented2022.1042.4
REALMModel Type=Retrieval-augmented2022.1040.7
QAMATModel Type=Retrieval-augmented2022.1039.4
RePAQ rerankModel Type=Retrieval-augmented2022.1037.6
T5-11BModel Type=Parametric2022.1037.2
EMAT-FKSVAccess Delay Setting=Fast Key, Slow Value (FKSV), Backbone=T5-base2022.1036.7
T5-3BModel Type=Parametric2022.1033.6
EMAT-SKSVAccess Delay Setting=Slow Key, Slow Value (SKSV), Backbone=T5-base2022.1033.2
FiD-baseModel Type=Retrieval-augmented, Backbone=T5-base2022.1032.4
RePAQ-baseModel Type=Retrieval-only2022.1029.4
Dense RetrieverModel Type=Retrieval-only2022.1028.9
T5-largeModel Type=Parametric2022.1027.7
BART-largeModel Type=Parametric2022.1027.4
T5-baseModel Type=Parametric2022.1026.6