Information Retrieval on SciFact (nDCG@10)
77.77nDCG@10text-embedding-ada-002
Evaluation Results
| Method | Links | |
|---|---|---|
| text-embedding-ada-002Dim.=1,536, Type=Dense2025.05 | 77.77 | |
| AngIEDim.=1,024, Type=Dense2025.05 | 74.07 | |
| SPQEretriever=Sparse BM252025.10 | 71.4 | |
| ModernBERTembDim.=1,024, Type=Dense2025.05 | 69.98 | |
| SPQEretriever=Dense, backbone=Contriever-msmarco2025.10 | 68.9 | |
| BM25Dim.=N/A, Type=Sparse2025.05 | 68.7 | |
| OPQEretriever=Sparse BM25, model_scale=7B2025.10 | 68.6 | |
| OPQEretriever=Dense, backbone=Contriever-msmarco, model_scale=7B2025.10 | 68.4 | |
| OPQEretriever=Sparse BM25, model_scale=3B2025.10 | 67.9 | |
| OPQEretriever=Dense, backbone=Contriever-msmarco, model_scale=3B2025.10 | 67.9 | |
| Baseretriever=Dense, backbone=Contriever-msmarco2025.10 | 67.7 | |
| DRretriever=Sparse BM25, model_scale=3B2025.10 | 66.9 | |
| DRretriever=Dense, backbone=Contriever-msmarco, model_scale=7B2025.10 | 66.9 | |
| Baseretriever=Sparse BM252025.10 | 66.5 | |
| LLM2VecDim.=4,096, Type=Dense2025.05 | 66.36 | |
| DRretriever=Dense, backbone=Contriever-msmarco, model_scale=3B2025.10 | 66.3 | |
| DRretriever=Sparse BM25, model_scale=7B2025.10 | 66.2 | |
| SBERTnewDim.=768, Type=Dense2025.05 | 62.64 | |
| LDIREncoder=AngIE, Dim.=500, Type=Dense2025.05 | 62.26 | |
| LDIREncoder=AngIE, Dim.=200, Type=Dense2025.05 | 59.85 | |
| LDIREncoder=SBERTnew, Dim.=500, Type=Dense2025.05 | 56.25 | |
| LDIREncoder=SBERTnew, Dim.=200, Type=Dense2025.05 | 55.42 | |
| LDIREncoder=ModernBERTemb, Dim.=500, Type=Dense2025.05 | 52.13 | |
| LDIREncoder=ModernBERTemb, Dim.=200, Type=Dense2025.05 | 49.59 | |
| Bag-of-WordsVocabulary=BERT, Dim.=28,996, Type=Sparse2025.05 | 47.36 | |
| CQG-MBQADim.=9,614, Type=0/1 Emb.2025.05 | 32.8 | |
| SimCSEsupDim.=768, Type=Dense2025.05 | 29.59 | |
| GloVeDim.=300, Type=Dense2025.05 | 29.58 | |
| SimCSEunsupDim.=768, Type=Dense2025.05 | 25.72 | |
| BERTbaseDim.=768, Type=Dense2025.05 | 13.34 | |
| QAEmb-MBQADim.=10,654, Type=0/1 Emb.2025.05 | 12.01 | |
| BioHiCL-largeSize=0.3B2026.04 | 0.765 | |
| BiCA-baseSize=0.1B2026.04 | 0.762 | |
| BMRetriever-1BSize=1B2026.04 | 0.76 | |
| BioHiCL-baseSize=0.1B2026.04 | 0.757 | |
| E5-Mistral-7BReasoning Enabled=false2025.10 | 0.748 | |
| bge-base-en-v1.5Size=0.1B2026.04 | 0.735 | |
| bge-large-en-v1.5Size=0.3B2026.04 | 0.735 | |
| BiCA-smallSize=0.03B2026.04 | 0.727 | |
| e5-large-v2Size=0.3B2026.04 | 0.726 | |
| MedCPT-QuerySize=0.1B2026.04 | 0.724 | |
| BMRetriever-410MSize=0.4B2026.04 | 0.711 | |
| SpladeV3Size=0.3B2026.04 | 0.71 | |
| SGPT-1.3BSize=1.3B2026.04 | 0.682 | |
| ContrieverSize=0.1B2026.04 | 0.677 | |
| GTR-T5-XXLReasoning Enabled=false2025.10 | 0.667 | |
| Search-R3-LargeReasoning Enabled=true2025.10 | 0.667 | |
| gtr-t5-xlSize=1.2B2026.04 | 0.635 | |
| Search-R3-LargeReasoning Enabled=false2025.10 | 0.564 | |
| Sentence-T5-XXLReasoning Enabled=false2025.10 | 0.554 | |
| BiomedBERTSize=0.1B2026.04 | 0.262 |