Question Answering on EntityQuestions (Infrequent)
38.6Exact Match (EM)RPDR
Evaluation results
| Method | Links | |
|---|---|---|
| RPDRGenerator=GPT-3.5, Retriever=RPDR2026.02 | 38.6 | |
| ContrieverGenerator=GPT-3.5, Retriever=Contriever2026.02 | 37.8 | |
| BM25Generator=GPT-3.5, Retriever=BM252026.02 | 35.4 | |
| RPDRGenerator=GPT-neox 20B, Retriever=RPDR2026.02 | 33.7 | |
| RPDRGenerator=GPT-j-6B, Retriever=RPDR2026.02 | 32.8 | |
| RPDRGenerator=LLaMA-3 8B, Retriever=RPDR2026.02 | 31.6 | |
| BM25Generator=GPT-neox 20B, Retriever=BM252026.02 | 29.9 | |
| Parametric knowledgeGenerator=GPT-3.5, Retriever=Parametric2026.02 | 29.9 | |
| BM25Generator=LLaMA-3 8B, Retriever=BM252026.02 | 29.6 | |
| BM25Generator=GPT-j-6B, Retriever=BM252026.02 | 27.1 | |
| ContrieverGenerator=GPT-j-6B, Retriever=Contriever2026.02 | 26.6 | |
| ContrieverGenerator=LLaMA-3 8B, Retriever=Contriever2026.02 | 25.4 | |
| ContrieverGenerator=GPT-neox 20B, Retriever=Contriever2026.02 | 24.9 | |
| Parametric knowledgeGenerator=LLaMA-3 8B, Retriever=Parametric2026.02 | 14.5 | |
| Parametric knowledgeGenerator=GPT-neox 20B, Retriever=Parametric2026.02 | 12.8 | |
| Parametric knowledgeGenerator=GPT-j-6B, Retriever=Parametric2026.02 | 12.1 |