Question Answering on HotpotQA original questions as queries BEIR
46.9Accuracyretriever-specific rewrite
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| retriever-specific rewriteGenerator=Qwen2.5-7B-Instruct, Retriever=Contriever, Top-k retrieved documents=202026.06 | 46.9 | 46 | 35.2 | |
| retriever-specific rewriteGenerator=Qwen2.5-7B-Instruct, Retriever=Contriever, Top-k retrieved documents=52026.06 | 43.7 | 43 | 32.8 | |
| general rewrite w/ GeminiGenerator=Qwen2.5-7B-Instruct, Retriever=Contriever, Rewriter=Gemini-2.5-flash, Top-k retrieved documents=202026.06 | 42.3 | 42 | 32 | |
| vanilla RAGGenerator=Qwen2.5-7B-Instruct, Retriever=Contriever, Top-k retrieved documents=202026.06 | 41.4 | 41 | 31.2 | |
| general rewrite w/ GeminiGenerator=Qwen2.5-7B-Instruct, Retriever=Contriever, Rewriter=Gemini-2.5-flash, Top-k retrieved documents=52026.06 | 38.1 | 38 | 28.5 | |
| vanilla RAGGenerator=Qwen2.5-7B-Instruct, Retriever=Contriever, Top-k retrieved documents=52026.06 | 36.5 | 36 | 27.3 | |
| no RAGGenerator=Qwen2.5-7B-Instruct, Top-k retrieved documents=202026.06 | 25.3 | 26 | 18.8 | |
| no RAGGenerator=Qwen2.5-7B-Instruct, Top-k retrieved documents=52026.06 | 25.3 | 26 | 18.8 |