# Information Retrieval on Natural Questions BEIR Source: [Information Retrieval on Natural Questions BEIR]() Collection index: [llms.txt]() Data updated: 2026-03-20T09:45:08.601Z Evaluation of model performance on the Natural Questions BEIR dataset for Information Retrieval tasks, measured using NDCG@10. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Information Retrieval | | Dataset (including any stated split) | Natural Questions BEIR | | Metric | NDCG@10 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [NDCG@10](): Higher is better; unit: PERCENT. ## Recorded results | Method | NDCG@10 | Result date | Report paper | | --- | --- | --- | --- | | bge-en-icl | 73.9 | Not recorded | 68fa7bc41e209131cea8a4c0 | | LENS-d4K | 73.1 | Not recorded | 68fa7bc41e209131cea8a4c0 | | inf-v1 | 69.7 | Not recorded | 68fa7bc41e209131cea8a4c0 | | Qwen3-8B | 65.3 | Not recorded | 68fa7bc41e209131cea8a4c0 | | MILCO | 64.9 | Not recorded | 68fa7bc41e209131cea8a4c0 | | inf-v1-1.5b | 64.2 | Not recorded | 68fa7bc41e209131cea8a4c0 | | e5-large | 64 | Not recorded | 68fa7bc41e209131cea8a4c0 | | Qwen3-4B | 63.1 | Not recorded | 68fa7bc41e209131cea8a4c0 | | Splade-V3 | 58.6 | Not recorded | 68fa7bc41e209131cea8a4c0 | | opensearch-gte | 58.2 | Not recorded | 68fa7bc41e209131cea8a4c0 | | e5-large-inst | 57.8 | Not recorded | 68fa7bc41e209131cea8a4c0 | | bge-lg-v1.5 | 55 | Not recorded | 68fa7bc41e209131cea8a4c0 | | gte-large | 54.8 | Not recorded | 68fa7bc41e209131cea8a4c0 | | Qwen3-0.6B | 53.5 | Not recorded | 68fa7bc41e209131cea8a4c0 | | bge-large | 53.2 | Not recorded | 68fa7bc41e209131cea8a4c0 | | gte-base-v1.5 | 53 | Not recorded | 68fa7bc41e209131cea8a4c0 | | gte-base | 52.8 | Not recorded | 68fa7bc41e209131cea8a4c0 | ### bge-en-icl NDCG@10: 73.9. Result ID: 69bd171147f34ce924a794e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\>=1B parameters"}. This record does not assert independent reproduction. ### LENS-d4K NDCG@10: 73.1. Result ID: 69bd171147f34ce924a794e5. [Reporting paper]() Recorded evaluation configuration: {"Model Size Category":"\>=1B parameters"}. This record does not assert independent reproduction. ### inf-v1 NDCG@10: 69.7. Result ID: 69bd171147f34ce924a794e6. [Reporting paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### Qwen3-8B NDCG@10: 65.3. Result ID: 69bd171147f34ce924a794df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\>=1B parameters"}. This record does not assert independent reproduction. ### MILCO NDCG@10: 64.9. Result ID: 69bd171147f34ce924a794ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### inf-v1-1.5b NDCG@10: 64.2. Result ID: 69bd171147f34ce924a794e2. [Reporting paper]() Recorded evaluation configuration: {"Model Size Category":"\>=1B parameters"}. This record does not assert independent reproduction. ### e5-large NDCG@10: 64. Result ID: 69bd171147f34ce924a794ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### Qwen3-4B NDCG@10: 63.1. Result ID: 69bd171147f34ce924a794e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\>=1B parameters"}. This record does not assert independent reproduction. ### Splade-V3 NDCG@10: 58.6. Result ID: 69bd171147f34ce924a794ee. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### opensearch-gte NDCG@10: 58.2. Result ID: 69bd171147f34ce924a794ed. [Reporting paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### e5-large-inst NDCG@10: 57.8. Result ID: 69bd171147f34ce924a794e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\>=1B parameters"}. This record does not assert independent reproduction. ### bge-lg-v1.5 NDCG@10: 55. Result ID: 69bd171147f34ce924a794eb. [Reporting paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### gte-large NDCG@10: 54.8. Result ID: 69bd171147f34ce924a794e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\>=1B parameters"}. This record does not assert independent reproduction. ### Qwen3-0.6B NDCG@10: 53.5. Result ID: 69bd171147f34ce924a794ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### bge-large NDCG@10: 53.2. Result ID: 69bd171147f34ce924a794e8. [Reporting paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### gte-base-v1.5 NDCG@10: 53. Result ID: 69bd171147f34ce924a794e9. [Reporting paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. ### gte-base NDCG@10: 52.8. Result ID: 69bd171147f34ce924a794e7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size Category":"\<1B parameters"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.