Information Retrieval on FiQA (nDCG@10, Overlap%, Spearman)
55.6nDCG@10Naive
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| NaiveRetriever Model=Jasper, Embedding Dimension=512d2026.04 | 55.6 | 100 | 1 | |
| Trans-RAGRetriever Model=Jasper, Embedding Dimension=512d2026.04 | 53.5 | 91.2 | 0.737 | |
| NaiveRetriever Model=MPNet, Embedding Dimension=768d2026.04 | 49.6 | 100 | 1 | |
| Trans-RAGRetriever Model=MPNet, Embedding Dimension=768d2026.04 | 47.8 | 92.4 | 0.851 | |
| NaiveRetriever Model=Linq, Embedding Dimension=4096d2026.04 | 46 | 100 | 1 | |
| NaiveRetriever Model=UAE, Embedding Dimension=1024d2026.04 | 44.5 | 100 | 1 | |
| Trans-RAGRetriever Model=Linq, Embedding Dimension=4096d2026.04 | 44.4 | 92.7 | 0.858 | |
| NaiveRetriever Model=Ember, Embedding Dimension=1024d2026.04 | 44.3 | 100 | 1 | |
| Trans-RAGRetriever Model=UAE, Embedding Dimension=1024d2026.04 | 43 | 92.4 | 0.847 | |
| Trans-RAGRetriever Model=Ember, Embedding Dimension=1024d2026.04 | 42.7 | 92.5 | 0.856 | |
| NaiveRetriever Model=BGE, Embedding Dimension=768d2026.04 | 42.4 | 100 | 1 | |
| Trans-RAGRetriever Model=BGE, Embedding Dimension=768d2026.04 | 40.8 | 92.4 | 0.85 | |
| NaiveRetriever Model=GTE, Embedding Dimension=1024d2026.04 | 22.8 | 100 | 1 | |
| Trans-RAGRetriever Model=GTE, Embedding Dimension=1024d2026.04 | 22 | 92.3 | 0.843 | |
| NaiveRetriever Model=Stella, Embedding Dimension=8192d2026.04 | 20 | 100 | 1 | |
| Trans-RAGRetriever Model=Stella, Embedding Dimension=8192d2026.04 | 19.4 | 93.2 | 0.921 |