List your company
ResearchFormerly WizWand

Scientific Paper Retrieval on SCIFULLBENCH ICLR-NeurIPS (Citations) 1.0

44.21nDCG@300COR
26.852431.358735.86540.3713Jul 14, 2025
Updated 7mo ago

Evaluation results

MethodLinks
CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=QWEN-2.5-3B-Instruct2025.0744.2162.06
CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=Llama-3.2-3B-Instruct2025.0743.6661.54
CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=QWEN-2.5-3B-Instruct2025.0739.3656.97
Inf-Retriever-v1-1.5BRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0738.6154.63
CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=Llama-3.2-3B-Instruct2025.0738.5856.21
BM-25Retrieval Protocol=Full-to-Full (F2F)2025.0736.4847.47
Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Full-to-Full (F2F)2025.0735.849.63
CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=QWEN-2.5-3B-Instruct2025.0735.7250.77
Inf-Retriever-v1-1.5BRetrieval Protocol=Full-to-Full (F2F)2025.0735.5848.79
CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=Llama-3.2-3B-Instruct2025.0734.5449.27
SPECTER2-BaseRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0734.4849.09
Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0733.8547.89
SPECTER2-Adapter-MTL CTRLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0733.1247.38
SciNCLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0733.0747.9
BGE-M3Retrieval Protocol=Full-to-Full (F2F)2025.0732.2244.01
BGE-M3Retrieval Protocol=Abstract-to-Abstract (A2A)2025.0730.3142.85
SciMult-MHAExpertRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0728.3241.07
BM-25Retrieval Protocol=Abstract-to-Abstract (A2A)2025.0727.5237.41