Information Retrieval on NFCorpus (nDCG@10, Overlap%, Spearman)
39nDCG@10Naive
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| NaiveRetriever Model=Jasper, Embedding Dimension=512d2026.04 | 39 | 100 | 1 | |
| Trans-RAGRetriever Model=Jasper, Embedding Dimension=512d2026.04 | 37.5 | 92.3 | 0.804 | |
| NaiveRetriever Model=BGE, Embedding Dimension=768d2026.04 | 36.2 | 100 | 1 | |
| Trans-RAGRetriever Model=BGE, Embedding Dimension=768d2026.04 | 34.9 | 91.8 | 0.762 | |
| NaiveRetriever Model=UAE, Embedding Dimension=1024d2026.04 | 32 | 100 | 1 | |
| NaiveRetriever Model=Ember, Embedding Dimension=1024d2026.04 | 31.4 | 100 | 1 | |
| NaiveRetriever Model=Linq, Embedding Dimension=4096d2026.04 | 31 | 100 | 1 | |
| Trans-RAGRetriever Model=UAE, Embedding Dimension=1024d2026.04 | 30.9 | 92.7 | 0.845 | |
| Trans-RAGRetriever Model=Ember, Embedding Dimension=1024d2026.04 | 30.3 | 92.8 | 0.86 | |
| Trans-RAGRetriever Model=Linq, Embedding Dimension=4096d2026.04 | 29.9 | 92.9 | 0.862 | |
| NaiveRetriever Model=MPNet, Embedding Dimension=768d2026.04 | 28.9 | 100 | 1 | |
| Trans-RAGRetriever Model=MPNet, Embedding Dimension=768d2026.04 | 27.9 | 92.4 | 0.811 | |
| NaiveRetriever Model=Stella, Embedding Dimension=8192d2026.04 | 22.7 | 100 | 1 | |
| Trans-RAGRetriever Model=Stella, Embedding Dimension=8192d2026.04 | 21.9 | 93.7 | 0.931 | |
| NaiveRetriever Model=GTE, Embedding Dimension=1024d2026.04 | 20.4 | 100 | 1 | |
| Trans-RAGRetriever Model=GTE, Embedding Dimension=1024d2026.04 | 19.7 | 92.8 | 0.855 |