# Information Retrieval on SciFact (nDCG@10, Overlap%, Spearman) Source: [Information Retrieval on SciFact (nDCG@10, Overlap%, Spearman)]() Collection index: [llms.txt]() Data updated: 2026-04-13T10:15:15.185Z Evaluation of Information Retrieval performance on the SciFact dataset, measured using nDCG@10, Overlap percentage, and Spearman correlation. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Information Retrieval | | Dataset (including any stated split) | SciFact | | Metric | nDCG@10 | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [nDCG@10](): Higher is better; unit: SCALAR. - [Overlap Percentage](): Higher is better; unit: PERCENT. - [Spearman Correlation](): Higher is better; unit: SCALAR. ## Recorded results | Method | nDCG@10 | Result date | Report paper | | --- | --- | --- | --- | | Naive | 0.77 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 0.747 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.745 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 0.743 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 0.737 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 0.725 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.721 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.716 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.712 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.701 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 0.634 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.613 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 0.531 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.513 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 0.354 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 0.343 | Not recorded | 69dc78a87d0172140ec78c66 | ### Naive nDCG@10: 0.77. Result ID: 69dcc21747f34ce924c43cc5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Jasper","Embedding Dimension":"512d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 0.747. Result ID: 69dcc21747f34ce924c43cc3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"BGE","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.745. Result ID: 69dcc21747f34ce924c43cc6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Jasper","Embedding Dimension":"512d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 0.743. Result ID: 69dcc21747f34ce924c43cbd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"UAE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 0.737. Result ID: 69dcc21747f34ce924c43cbb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Ember","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 0.725. Result ID: 69dcc21747f34ce924c43cc9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Linq","Embedding Dimension":"4096d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.721. Result ID: 69dcc21747f34ce924c43cc4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"BGE","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.716. Result ID: 69dcc21747f34ce924c43cbe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"UAE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.712. Result ID: 69dcc21747f34ce924c43cbc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Ember","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.701. Result ID: 69dcc21747f34ce924c43cca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Linq","Embedding Dimension":"4096d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 0.634. Result ID: 69dcc21747f34ce924c43cc1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"MPNet","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.613. Result ID: 69dcc21747f34ce924c43cc2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"MPNet","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 0.531. Result ID: 69dcc21747f34ce924c43cc7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Stella","Embedding Dimension":"8192d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.513. Result ID: 69dcc21747f34ce924c43cc8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Stella","Embedding Dimension":"8192d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 0.354. Result ID: 69dcc21747f34ce924c43cbf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"GTE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 0.343. Result ID: 69dcc21747f34ce924c43cc0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"GTE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.