List your company
ResearchFormerly WizWand

Information Retrieval on SciFact (nDCG@10)

77.77nDCG@10text-embedding-ada-002
-2.8383218.0888439.01659.94316May 15, 2025Jul 10, 2025Sep 4, 2025Oct 30, 2025Dec 25, 2025Feb 19, 2026Apr 17, 2026
Updated 6mo ago

Evaluation results

MethodLinks
text-embedding-ada-002Dim.=1,536, Type=Dense2025.0577.77
AngIEDim.=1,024, Type=Dense2025.0574.07
SPQEretriever=Sparse BM252025.1071.4
ModernBERTembDim.=1,024, Type=Dense2025.0569.98
SPQEretriever=Dense, backbone=Contriever-msmarco2025.1068.9
BM25Dim.=N/A, Type=Sparse2025.0568.7
OPQEretriever=Sparse BM25, model_scale=7B2025.1068.6
OPQEretriever=Dense, backbone=Contriever-msmarco, model_scale=7B2025.1068.4
OPQEretriever=Sparse BM25, model_scale=3B2025.1067.9
OPQEretriever=Dense, backbone=Contriever-msmarco, model_scale=3B2025.1067.9
Baseretriever=Dense, backbone=Contriever-msmarco2025.1067.7
DRretriever=Sparse BM25, model_scale=3B2025.1066.9
DRretriever=Dense, backbone=Contriever-msmarco, model_scale=7B2025.1066.9
Baseretriever=Sparse BM252025.1066.5
LLM2VecDim.=4,096, Type=Dense2025.0566.36
DRretriever=Dense, backbone=Contriever-msmarco, model_scale=3B2025.1066.3
DRretriever=Sparse BM25, model_scale=7B2025.1066.2
SBERTnewDim.=768, Type=Dense2025.0562.64
LDIREncoder=AngIE, Dim.=500, Type=Dense2025.0562.26
LDIREncoder=AngIE, Dim.=200, Type=Dense2025.0559.85
LDIREncoder=SBERTnew, Dim.=500, Type=Dense2025.0556.25
LDIREncoder=SBERTnew, Dim.=200, Type=Dense2025.0555.42
LDIREncoder=ModernBERTemb, Dim.=500, Type=Dense2025.0552.13
LDIREncoder=ModernBERTemb, Dim.=200, Type=Dense2025.0549.59
Bag-of-WordsVocabulary=BERT, Dim.=28,996, Type=Sparse2025.0547.36
CQG-MBQADim.=9,614, Type=0/1 Emb.2025.0532.8
SimCSEsupDim.=768, Type=Dense2025.0529.59
GloVeDim.=300, Type=Dense2025.0529.58
SimCSEunsupDim.=768, Type=Dense2025.0525.72
BERTbaseDim.=768, Type=Dense2025.0513.34
QAEmb-MBQADim.=10,654, Type=0/1 Emb.2025.0512.01
BioHiCL-largeSize=0.3B2026.040.765
BiCA-baseSize=0.1B2026.040.762
BMRetriever-1BSize=1B2026.040.76
BioHiCL-baseSize=0.1B2026.040.757
E5-Mistral-7BReasoning Enabled=false2025.100.748
bge-base-en-v1.5Size=0.1B2026.040.735
bge-large-en-v1.5Size=0.3B2026.040.735
BiCA-smallSize=0.03B2026.040.727
e5-large-v2Size=0.3B2026.040.726
MedCPT-QuerySize=0.1B2026.040.724
BMRetriever-410MSize=0.4B2026.040.711
SpladeV3Size=0.3B2026.040.71
SGPT-1.3BSize=1.3B2026.040.682
ContrieverSize=0.1B2026.040.677
GTR-T5-XXLReasoning Enabled=false2025.100.667
Search-R3-LargeReasoning Enabled=true2025.100.667
gtr-t5-xlSize=1.2B2026.040.635
Search-R3-LargeReasoning Enabled=false2025.100.564
Sentence-T5-XXLReasoning Enabled=false2025.100.554
BiomedBERTSize=0.1B2026.040.262