Question Answering on EntityQuestions (Long-tail)
36.4Exact Match AccuracyRPDR
Evaluation results
| Method | Links | |
|---|---|---|
| RPDRGenerator=GPT-3.5, Retriever=RPDR2026.02 | 36.4 | |
| BM25Generator=GPT-3.5, Retriever=BM252026.02 | 35.9 | |
| RPDRGenerator=GPT-neox 20B, Retriever=RPDR2026.02 | 33.5 | |
| ContrieverGenerator=GPT-3.5, Retriever=Contriever2026.02 | 32.5 | |
| RPDRGenerator=LLaMA-3 8B, Retriever=RPDR2026.02 | 30.1 | |
| RPDRGenerator=GPT-j-6B, Retriever=RPDR2026.02 | 28.9 | |
| BM25Generator=GPT-neox 20B, Retriever=BM252026.02 | 27.8 | |
| BM25Generator=LLaMA-3 8B, Retriever=BM252026.02 | 27.8 | |
| ContrieverGenerator=GPT-neox 20B, Retriever=Contriever2026.02 | 23.7 | |
| BM25Generator=GPT-j-6B, Retriever=BM252026.02 | 23.2 | |
| ContrieverGenerator=LLaMA-3 8B, Retriever=Contriever2026.02 | 21.8 | |
| Parametric knowledgeGenerator=GPT-3.5, Retriever=Parametric2026.02 | 20.6 | |
| ContrieverGenerator=GPT-j-6B, Retriever=Contriever2026.02 | 16.5 | |
| Parametric knowledgeGenerator=LLaMA-3 8B, Retriever=Parametric2026.02 | 10.3 | |
| Parametric knowledgeGenerator=GPT-neox 20B, Retriever=Parametric2026.02 | 10.1 | |
| Parametric knowledgeGenerator=GPT-j-6B, Retriever=Parametric2026.02 | 9.7 |