Information Retrieval on RAGBench
60.5CovidQA ScoreQwen3-Embedding-0.6B + rewrite general
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-Embedding-0.6B + rewrite generalRetriever=Qwen3-Embedding-0.6B, Rewriting Strategy=general2026.06 | 60.5 | — | 83.4 | 77.4 | 66.9 | 30 | 89.4 | 68 | 84.5 | 83.2 | 20.1 | 41.2 | 64.1 | |
| Qwen3-Embedding-0.6BRetriever=Qwen3-Embedding-0.6B, Rewriting Strategy=None2026.06 | 56.3 | — | 77.8 | 73.7 | 66.7 | 27.1 | 89.2 | 67 | 81 | 79.1 | 17.6 | 41.2 | 61.5 | |
| Contriever + rewrite direct + turn2Retriever=Contriever, Rewriting Strategy=direct, Turns=22026.06 | 42.6 | — | 70.1 | 71.5 | 63.5 | 23.3 | 86.1 | 64.9 | 78.5 | 73 | 15 | 32.5 | 56.5 | |
| Contriever + rewrite directRetriever=Contriever, Rewriting Strategy=direct2026.06 | 42.1 | — | 71.3 | 71.1 | 62.6 | 23.3 | 87.2 | 63.9 | 78.1 | 72.9 | 14.9 | 31.9 | 56.3 | |
| Contriever + rewrite exploreRetriever=Contriever, Rewriting Strategy=explore2026.06 | 41.9 | — | 72.1 | 65.2 | 54.7 | 18.1 | 82.4 | 63.9 | 77.2 | 68.5 | 12.3 | 27.9 | 53.2 | |
| Contriever + rewrite general + turn2Retriever=Contriever, Rewriting Strategy=general, Turns=22026.06 | 41.8 | — | 68.7 | 62.8 | 64 | 22.9 | 87.9 | 68.1 | 76 | 69.9 | 13.9 | 30.9 | 55.2 | |
| all-MiniLM-L6-v2 + rewrite generalRetriever=all-MiniLM-L6-v2, Rewriting Strategy=general2026.06 | 41.4 | — | 72.1 | 71.1 | 61.2 | 13.5 | 86.4 | 61.1 | 81.8 | 75.4 | 13.7 | 31.4 | 55.4 | |
| BM25 + rewrite exploreRetriever=BM25, Rewriting Strategy=explore2026.06 | 40.5 | — | 66.1 | 66.3 | 46.1 | 33.4 | 77.9 | 82.6 | 72.5 | 61.9 | 24.9 | 53.7 | 56.9 | |
| Contriever + rewrite generalRetriever=Contriever, Rewriting Strategy=general2026.06 | 40.4 | — | 70 | 65.7 | 60.8 | 21 | 85.8 | 64.1 | 77.2 | 71.4 | 13.6 | 30 | 54.5 | |
| BM25 + rewrite directRetriever=BM25, Rewriting Strategy=direct2026.06 | 40.2 | — | 66 | 66.2 | 47 | 31.3 | 77.4 | 82.2 | 71.3 | 61.7 | 24.4 | 50.1 | 56.2 | |
| all-MiniLM-L6-v2Retriever=all-MiniLM-L6-v2, Rewriting Strategy=None2026.06 | 39.7 | — | 68.1 | 65.5 | 61.2 | 11.1 | 84.4 | 58.8 | 79.3 | 72.2 | 11.2 | 30.3 | 52.9 | |
| BM25 + rewrite generalRetriever=BM25, Rewriting Strategy=general2026.06 | 37.6 | — | 66.1 | 56.1 | 49.2 | 29.3 | 74.9 | 71.1 | 69.8 | 58.6 | 21.5 | 49.7 | 53.1 | |
| ContrieverRetriever=Contriever, Rewriting Strategy=None2026.06 | 36 | — | 61.6 | 55.1 | 52.5 | 14.4 | 68.9 | 43.8 | 72 | 62.3 | 8.6 | 24.7 | 45.5 | |
| BM25Retriever=BM25, Rewriting Strategy=None2026.06 | 30.8 | — | 57.3 | 40 | 50.6 | 20 | 67.3 | 68.7 | 57.9 | 48.1 | 10.4 | 44 | 45 |