List your company
ResearchFormerly WizWand

Scientific Paper Retrieval on SCIFULLBENCH ACL-EMNLP (Citations) 1.0

36.87nDCG@300COR
20.219624.542328.86533.1877Jul 14, 2025
Updated 7mo ago

Evaluation results

MethodLinks
CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=QWEN-2.5-3B-Instruct2025.0736.8753.59
CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=Llama-3.2-3B-Instruct2025.0736.1852.95
CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=QWEN-2.5-3B-Instruct2025.0732.5448.3
CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=Llama-3.2-3B-Instruct2025.0731.847.03
Inf-Retriever-v1-1.5BRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0730.9445.53
Inf-Retriever-v1-1.5BRetrieval Protocol=Full-to-Full (F2F)2025.0730.3143.64
CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=QWEN-2.5-3B-Instruct2025.0729.3343.72
CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=Llama-3.2-3B-Instruct2025.0728.8742.67
Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Full-to-Full (F2F)2025.0728.3440.65
BM-25Retrieval Protocol=Full-to-Full (F2F)2025.0728.0838.58
SPECTER2-BaseRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0726.8540.21
Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0726.4538.92
SciNCLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0725.5838.91
SPECTER2-Adapter-MTL CTRLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0725.4838.54
BGE-M3Retrieval Protocol=Full-to-Full (F2F)2025.0724.8535.87
BGE-M3Retrieval Protocol=Abstract-to-Abstract (A2A)2025.0724.4136.28
SciMult-MHAExpertRetrieval Protocol=Abstract-to-Abstract (A2A)2025.0722.5733.79
BM-25Retrieval Protocol=Abstract-to-Abstract (A2A)2025.0720.8629.37