Question Answering on EntityQuestions Frequent
38.7Exact Match AccuracyRPDR
Evaluation results
| Method | Links | |
|---|---|---|
| RPDRGenerator=GPT-3.5, Retriever=RPDR2026.02 | 38.7 | |
| ContrieverGenerator=GPT-3.5, Retriever=Contriever2026.02 | 38.4 | |
| Parametric knowledgeGenerator=GPT-3.5, Retriever=Parametric2026.02 | 36.8 | |
| RPDRGenerator=GPT-neox 20B, Retriever=RPDR2026.02 | 35.9 | |
| BM25Generator=GPT-neox 20B, Retriever=BM252026.02 | 35.6 | |
| BM25Generator=GPT-3.5, Retriever=BM252026.02 | 35.6 | |
| ContrieverGenerator=GPT-neox 20B, Retriever=Contriever2026.02 | 34.4 | |
| RPDRGenerator=LLaMA-3 8B, Retriever=RPDR2026.02 | 33.9 | |
| BM25Generator=LLaMA-3 8B, Retriever=BM252026.02 | 32.8 | |
| ContrieverGenerator=GPT-j-6B, Retriever=Contriever2026.02 | 30.2 | |
| ContrieverGenerator=LLaMA-3 8B, Retriever=Contriever2026.02 | 30.2 | |
| BM25Generator=GPT-j-6B, Retriever=BM252026.02 | 29.8 | |
| RPDRGenerator=GPT-j-6B, Retriever=RPDR2026.02 | 29.2 | |
| Parametric knowledgeGenerator=LLaMA-3 8B, Retriever=Parametric2026.02 | 21.7 | |
| Parametric knowledgeGenerator=GPT-neox 20B, Retriever=Parametric2026.02 | 14.8 | |
| Parametric knowledgeGenerator=GPT-j-6B, Retriever=Parametric2026.02 | 12.9 |