Information Retrieval on HotpotQA BEIR
85.1NDCG@10bge-en-icl
Evaluation Results
| Method | Links | |
|---|---|---|
| bge-en-iclModel Size Category=>=1B parameters2025.10 | 85.1 | |
| LENS-d4KModel Size Category=>=1B parameters2025.10 | 85.1 | |
| inf-v1Model Size Category=<1B parameters2025.10 | 82 | |
| MILCOModel Size Category=<1B parameters2025.10 | 77.7 | |
| Qwen3-8BModel Size Category=>=1B parameters2025.10 | 76.8 | |
| inf-v1-1.5bModel Size Category=>=1B parameters2025.10 | 76.3 | |
| Qwen3-4BModel Size Category=>=1B parameters2025.10 | 74.7 | |
| bge-largeModel Size Category=<1B parameters2025.10 | 74.6 | |
| bge-lg-v1.5Model Size Category=<1B parameters2025.10 | 74.1 | |
| opensearch-gteModel Size Category=<1B parameters2025.10 | 71.6 | |
| e5-largeModel Size Category=<1B parameters2025.10 | 71.2 | |
| e5-large-instModel Size Category=>=1B parameters2025.10 | 69.3 | |
| Splade-V3Model Size Category=<1B parameters2025.10 | 69.2 | |
| gte-base-v1.5Model Size Category=<1B parameters2025.10 | 67.8 | |
| gte-largeModel Size Category=>=1B parameters2025.10 | 67.2 | |
| gte-baseModel Size Category=<1B parameters2025.10 | 65.8 | |
| Qwen3-0.6BModel Size Category=<1B parameters2025.10 | 65.7 | |
| retriever-specific rewriteRetriever=Contriever, Top-k retrieved documents=202026.06 | 52.44 | |
| retriever-specific rewriteRetriever=Contriever, Top-k retrieved documents=52026.06 | 52.44 | |
| vanilla RAGRetriever=Contriever, Top-k retrieved documents=202026.06 | 41.01 | |
| vanilla RAGRetriever=Contriever, Top-k retrieved documents=52026.06 | 41.01 | |
| general rewrite w/ GeminiRetriever=Contriever, Rewriter=Gemini-2.5-flash, Top-k retrieved documents=202026.06 | 39.16 | |
| general rewrite w/ GeminiRetriever=Contriever, Rewriter=Gemini-2.5-flash, Top-k retrieved documents=52026.06 | 39.16 |