# Information Retrieval on FiQA (nDCG@10, Overlap%, Spearman) Source: [Information Retrieval on FiQA (nDCG@10, Overlap%, Spearman)]() Collection index: [llms.txt]() Data updated: 2026-04-13T10:15:15.112Z Evaluation of Information Retrieval performance on the FiQA dataset using nDCG@10, Overlap%, and Spearman correlation metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Information Retrieval | | Dataset (including any stated split) | FiQA | | Metric | nDCG@10 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [nDCG@10](): Higher is better; unit: PERCENT. - [Overlap (%)](): Higher is better; unit: PERCENT. - [Spearman Correlation](): Higher is better; unit: SCALAR. ## Recorded results | Method | nDCG@10 | Result date | Report paper | | --- | --- | --- | --- | | Naive | 55.6 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 53.5 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 49.6 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 47.8 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 46 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 44.5 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 44.4 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 44.3 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 43 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 42.7 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 42.4 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 40.8 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 22.8 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 22 | Not recorded | 69dc78a87d0172140ec78c66 | | Naive | 20 | Not recorded | 69dc78a87d0172140ec78c66 | | Trans-RAG | 19.4 | Not recorded | 69dc78a87d0172140ec78c66 | ### Naive nDCG@10: 55.6. Result ID: 69dcc21747f34ce924c43cb5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Jasper","Embedding Dimension":"512d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 53.5. Result ID: 69dcc21747f34ce924c43cb6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Jasper","Embedding Dimension":"512d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 49.6. Result ID: 69dcc21747f34ce924c43cb1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"MPNet","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 47.8. Result ID: 69dcc21747f34ce924c43cb2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"MPNet","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 46. Result ID: 69dcc21747f34ce924c43cb9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Linq","Embedding Dimension":"4096d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 44.5. Result ID: 69dcc21747f34ce924c43cad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"UAE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 44.4. Result ID: 69dcc21747f34ce924c43cba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Linq","Embedding Dimension":"4096d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 44.3. Result ID: 69dcc21747f34ce924c43cab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Ember","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 43. Result ID: 69dcc21747f34ce924c43cae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"UAE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 42.7. Result ID: 69dcc21747f34ce924c43cac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Ember","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 42.4. Result ID: 69dcc21747f34ce924c43cb3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"BGE","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 40.8. Result ID: 69dcc21747f34ce924c43cb4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"BGE","Embedding Dimension":"768d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 22.8. Result ID: 69dcc21747f34ce924c43caf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"GTE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 22. Result ID: 69dcc21747f34ce924c43cb0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"GTE","Embedding Dimension":"1024d"}. This record does not assert independent reproduction. ### Naive nDCG@10: 20. Result ID: 69dcc21747f34ce924c43cb7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever Model":"Stella","Embedding Dimension":"8192d"}. This record does not assert independent reproduction. ### Trans-RAG nDCG@10: 19.4. Result ID: 69dcc21747f34ce924c43cb8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Retriever Model":"Stella","Embedding Dimension":"8192d"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.