Open-Domain Question Answering on WebQuestions (WQ)
45.2Exact Match (EM)RAG
Evaluation Results
| Method | Links | |
|---|---|---|
| RAGModel Type=Retrieval-augmented2022.10 | 45.2 | |
| DPRModel Type=Retrieval-augmented2022.10 | 42.4 | |
| REALMModel Type=Retrieval-augmented2022.10 | 40.7 | |
| QAMATModel Type=Retrieval-augmented2022.10 | 39.4 | |
| RePAQ rerankModel Type=Retrieval-augmented2022.10 | 37.6 | |
| T5-11BModel Type=Parametric2022.10 | 37.2 | |
| EMAT-FKSVAccess Delay Setting=Fast Key, Slow Value (FKSV), Backbone=T5-base2022.10 | 36.7 | |
| T5-3BModel Type=Parametric2022.10 | 33.6 | |
| EMAT-SKSVAccess Delay Setting=Slow Key, Slow Value (SKSV), Backbone=T5-base2022.10 | 33.2 | |
| FiD-baseModel Type=Retrieval-augmented, Backbone=T5-base2022.10 | 32.4 | |
| RePAQ-baseModel Type=Retrieval-only2022.10 | 29.4 | |
| Dense RetrieverModel Type=Retrieval-only2022.10 | 28.9 | |
| T5-largeModel Type=Parametric2022.10 | 27.7 | |
| BART-largeModel Type=Parametric2022.10 | 27.4 | |
| T5-baseModel Type=Parametric2022.10 | 26.6 |