Scientific Paper Retrieval on SCIFULLBENCH ICLR-NeurIPS (Citations) 1.0
44.21nDCG@300COR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 44.21 | 62.06 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 43.66 | 61.54 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 39.36 | 56.97 | |
| Inf-Retriever-v1-1.5BRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 38.61 | 54.63 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 38.58 | 56.21 | |
| BM-25Retrieval Protocol=Full-to-Full (F2F)2025.07 | 36.48 | 47.47 | |
| Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Full-to-Full (F2F)2025.07 | 35.8 | 49.63 | |
| CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 35.72 | 50.77 | |
| Inf-Retriever-v1-1.5BRetrieval Protocol=Full-to-Full (F2F)2025.07 | 35.58 | 48.79 | |
| CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 34.54 | 49.27 | |
| SPECTER2-BaseRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 34.48 | 49.09 | |
| Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 33.85 | 47.89 | |
| SPECTER2-Adapter-MTL CTRLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 33.12 | 47.38 | |
| SciNCLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 33.07 | 47.9 | |
| BGE-M3Retrieval Protocol=Full-to-Full (F2F)2025.07 | 32.22 | 44.01 | |
| BGE-M3Retrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 30.31 | 42.85 | |
| SciMult-MHAExpertRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 28.32 | 41.07 | |
| BM-25Retrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 27.52 | 37.41 |