Knowledge-grounded Dialogue on WizInternet 1.0 (test)
17.7PPLWizInternet Search engine FiD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| WizInternet Search engine FiDKnowledge Access Method=Bing Search, Knowledge Source=CC, Base Model=BART-Large2021.07 | 17.7 | 16.8 | 6.9 | |
| WizInternet Search engine FiDKnowledge Access Method=Bing Search, Knowledge Source=CC+Wikipedia, Base Model=BART-Large2021.07 | 17.7 | 16.6 | 6.7 | |
| WizInternet Transformer (no knowledge)Knowledge Access Method=None, Knowledge Source=None, Base Model=BART-Large2021.07 | 18.7 | 16.9 | 6.8 | |
| WizInternet FiD-RAGKnowledge Access Method=DPR+FAISS, Knowledge Source=CC, Base Model=BART-Large2021.07 | 18.8 | 17 | 6.7 | |
| WizInternet Search term FiDKnowledge Access Method=Search Query+FAISS, Knowledge Source=CC, Base Model=BART-Large2021.07 | 19 | 16.5 | 6.7 | |
| WoW Search engine FiDKnowledge Access Method=Bing Search, Knowledge Source=CC, Base Model=BART-Large2021.07 | 21.9 | 14.3 | 7.3 | |
| WoW Transformer (no knowledge)Knowledge Access Method=None, Knowledge Source=None, Base Model=BART-Large2021.07 | 22.3 | 14.7 | 6.7 | |
| WoW FiD RAGKnowledge Access Method=DPR+FAISS, Knowledge Source=CC, Base Model=BART-Large2021.07 | 22.3 | 15.5 | 7.2 | |
| WoW FiDKnowledge Access Method=DPR+FAISS, Knowledge Source=CC, Base Model=BART-Large2021.07 | 22.8 | 15.3 | 7.3 | |
| WoW FiDKnowledge Access Method=DPR+FAISS, Knowledge Source=Wikipedia, Base Model=BART-Large2021.07 | 23 | 14.7 | 7.4 |