Scientific Paper Retrieval on SCIFULLBENCH ICLR-NeurIPS (References) 1.0
47.31nDCG@300COR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 47.31 | 65.31 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 47.21 | 64.78 | |
| Inf-Retriever-v1-1.5BRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 45.84 | 61.72 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 38.91 | 55.78 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 38.88 | 55.5 | |
| Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Full-to-Full (F2F)2025.07 | 37.05 | 50.6 | |
| Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 36.78 | 49.92 | |
| SciNCLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 36.24 | 51.8 | |
| SPECTER2-Adapter-MTL CTRLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 36.22 | 51.07 | |
| SPECTER2-BaseRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 35.24 | 50.41 | |
| CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 34.84 | 50.43 | |
| CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 33.81 | 49.39 | |
| BGE-M3Retrieval Protocol=Full-to-Full (F2F)2025.07 | 33.71 | 45.84 | |
| BGE-M3Retrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 32.08 | 44.09 | |
| Inf-Retriever-v1-1.5BRetrieval Protocol=Full-to-Full (F2F)2025.07 | 31.09 | 42.27 | |
| SciMult-MHAExpertRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 30.95 | 45.04 | |
| BM-25Retrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 28.29 | 38.21 | |
| BM-25Retrieval Protocol=Full-to-Full (F2F)2025.07 | 26.34 | 37.02 |